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Abstract 

Non-deductive reasoning systems are often representation dependent: representing the 
same situation in two different ways may cause such a system to return two different an- 
swers. Some have viewed this as a significant problem. For example, the principle of 
maximum entropy has been subjected to much criticism due to its representation depen- 
dence. There has, however, been almost no work investigating representation dependence. 
In this paper, we formalize this notion and show that it is not a problem specific to maxi- 
mum entropy. In fact, we show that any representation- independent probabilistic inference 
procedure that ignores irrelevant information is essentially entailment, in a precise sense. 
Moreover, we show that representation independence is incompatible with even a weak de- 
fault assumption of independence. We then show that invariance under a restricted class of 
representation changes can form a reasonable compromise between representation indepen- 
dence and other desiderata, and provide a construction of a family of inference procedures 
that provides such restricted representation independence, using relative entropy. 



1. Introduction 

It is well known that the way in which a problem is represented can have a significant impact 
on the ease with which people solve it, and on the complexity of an algorithm for solving 
it. We are interested in what is arguably an even more fundamental issue: the extent to 
which the answers that we get depend on how our input is represented. Here too, there is 
well known work, particularly by Tversky and Kahneman (see, for example, (Kahneman, 
Slovic, & Tversky, 1982)), showing that the answers given by people can vary significantly 
(and in systematic ways) depending on how a question is framed. This phenomenon is often 
viewed as indicating a problem with human information processing; the implicit assumption 
is that although people do make mistakes of this sort, they shouldn't. On the other hand, 
there is a competing intuition that suggests that representation does (and should) matter; 
representation dependence is just a natural consequence of this fact. 

Here we consider one type of reasoning, probabilistic inference, and examine the extent 
to which answers depend on the representation. The issue of representation dependence is of 
particular interest in this context because of the interest in using probability for knowledge 
representation (e.g., (Pearl, 1988)) and because probabilistic inference has been the source 
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of many of the concerns expressed regarding representation. However, our approach should 
be applicable far more generally. 

We begin by noting that the notion of "probabilistic inference" has two quite different 
interpretations. In one interpretation, which forms the basis for the Bayesian paradigm, 
probabilitic inference consists basically of conditioning: We start out with a prior distribu- 
tion over some event space, and then condition on whatever observations are obtained. In 
the other interpretation, we are given only a set of probabilistic assertions, and our goal 
is to reach conclusions about the probabilities of various events. For most of this paper, 
we focus on the latter interpretation, although we discuss the relationship to the Bayesian 
approach in Section 7.2. 

Suppose that we have a procedure for making inferences from a probabilistic knowledge 
base. How sensitive is it to the way knowledge is represented? Consider the following 
examples, which use perhaps the best-known non-deductive notion of probabilistic inference, 
maximum entropy (Jaynes, 1978). 1 

Example 1.1: Suppose that we have no information whatsoever regarding whether an 
object is colorful. What probability should we assign to the proposition colorful? Symmetry 
arguments might suggest 1/2. Since we have no information, it seems that an object should 
be just as likely to be colorful as non-colorful. This is also the conclusion reached by 
maximum entropy provided that the language has only the proposition colorful. But now 
suppose we know about the colors red, blue, and green, and have propositions corresponding 
to each of these colors. Moreover, by colorful we actually mean red V blue V green. In this 
case, maximum entropy dictates that the probability of red V blue V green is 7/8. Note that, 
in both cases, the only conclusion that follows from our constraints is the trivial one: that 
the probability of the query is somewhere between and 1. I 

Example 1.2: Suppose that we are told that half of the birds fly. There are two rea- 
sonable ways to represent this information. One is to have propositions bird and fly, and 
use a knowledge base KB± y =d c f [Pr(/?7/ | bird) = 1/2]. A second might be to have as 
basic predicates bird and flying-bird, and use a knowledge base KB^ =dcf [(flying-bird => 
bird) f\Vi(flying-bird \ bird) = 1/2]. Although the first representation may appear more nat- 
ural, it seems that both representations are intuitively adequate insofar as representing the 
information that we have been given. But if we use an inference method such as maximum 
entropy, the first representation leads us to infer Pr(bird) = 1/2, while the second leads us 
to infer Pr(bird) = 2/3. I 

Examples such as these are the basis for the frequent criticisms of maximum entropy 
on the grounds of representation dependence. But other than pointing out these examples, 
there has been little work on this problem. In fact, other than the work of Salmon (1961, 
1963) and Paris (1994), there seems to have been no work on formalizing the notion of rep- 
resentation dependence. One might say that the consensus was: "whatever representation 
independence is, it is not a property enjoyed by maximum entropy." But are there any 

1. Although much of our discussion is motivated by the representation-dependence problem encountered 
by maximum entropy, an understanding of maximum entropy and how it works is not essential for 
understanding our discussion. 
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other inference procedures that have it? In this paper we attempt to understand the notion 
of representation dependence, and to study the extent to which it is achievable. 

To study representation dependence, we must first understand what we mean by a 
"representation". The real world is complex. In any reasoning process, we must focus on 
certain details and ignore others. At a semantic level, the relevant distinctions are captured 
by using a space X of possible alternatives or states (possible worlds). In Example 1.1, our 
first representation focused on the single attribute colorful. In this case, we have only two 
states in the state space, corresponding to colorful being true and false, respectively. The 
second representation, using red, blue, and green, has a richer state space. Clearly, there 
are other distinctions that we could make. 

We can also interpret a representation as a syntactic entity. In this case, we typically cap- 
ture relevant distinctions using some formal language. For example, if we use propositional 
logic as our basic knowledge representation language, our choice of primitive propositions 
characterizes the distinctions that we have chosen to make. We can then take the states 
to be truth assignments to these propositions. Similarly, if we use a probabilistic repre- 
sentation language such as belief networks (Pearl, 1988) as our knowledge representation 
language, we must choose some set of relevant random variables. The states are then then 
possible assignments of values to these variables. 

What does it mean to shift from a representation (i.e., state space) X to another repre- 
sentation y? Roughly speaking, we want to capture at the level of the state space a shift 
from, say, feet to meters. Thus, in X distances might be described in terms of feet where 
in Y they might be described in terms of meters. We would expect there to be a constraint 
relating feet to meters. This constraint would not give any extra information about X; it 
would just relate worlds in X to worlds in Y. Thus, we first attempt to capture representa- 
tion independence somewhat indirectly, by requiring that adding constraints relating X to 
Y that place no constraints on X itself should not result in different conclusions about X. 
The resulting notion, called robustness, turns out to be surprisingly strong. We can show 
that every robust inference procedure must behave essentially like logical entailment. 

We then try to define representation independence more directly, by using a mapping / 
from one representation to another. For example, / could map a world where an individual 
is 6 feet tall to the corresponding world where the individual is 1.83 meters tall. Some 
obvious constraints on / are necessary to ensure that it corresponds to our intuition of a 
representation shift. We can then define a representation-independent inference procedure 
as one that preserves inferences under every legitimate mapping /; i.e., for any KB and 6, 
KB |~ iff f(KB) |~ /(#)■ 

This definition turns out to be somewhat more reasonable than our first attempt, in that 
there exist nontrivial representation-independent inference procedures. However, it is still 
a strong notion. In particular, any representation-independent inference procedure must 
act essentially like logical entailment for a knowledge base with only objective information 
(i.e., essentially non-probabilistic information). Moreover, we show that representation 
independence is incompatible with even the simplest default assumption of independence. 
Even if we are told nothing about the propositions p and q, representation independence 
does not allow us to jump to the conclusion that p and q are independent. 

These results suggest that if we want inference procedures that are capable of jumping 
to nontrivial conclusions, then we must accept at least some degree of representation de- 
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pendence. They add support to the claim that the choice of language does carry a great 
deal of information, and that complete representation independence is too much to expect. 
On a more positive note, we show that we can use the intuition that the choice of language 
carries information to get limited forms of representation independence. The idea is that the 
language should put further constraints on what counts as an "appropriate" representation 
shift. For example, suppose that certain propositions represent colors while others represent 
birds. While we may be willing to transform colorful to red V blue V green, we may not be 
willing to transform red to sparrow. There is no reason to demand that an inference pro- 
cedure behave the same way if we suddenly shift to a wildly inappropriate representation, 
where the symbols mean something completely different. We provide a general approach to 
constructing inference procedures that are invariant under a specific class of representation 
shifts. This construction allows us to combine some degree of representation independence 
with certain non-deductive properties that we want of our inference procedure. In partic- 
ular, we present an inference method that supports a default assumption of independence, 
and yet is invariant under a natural class of representation shifts. 

The rest of this paper is organized as follows. In Section 2, we define probabilistic infer- 
ence procedures and characterize them. In Section 3, we define robust inference procedures 
and show that every robust inference procedure is essentially entailment. In Section 4, we 
define representation independence, and show that representation independence is a very 
strong requirement. In particular, we show that a representation-independent inference 
procedure essentially acts like logical entailment on objective knowledge bases and that 
representation independence is incompatible with a default assumption of independence. 
Section 5 contains some general discussion of the notion of representation independence 
and how reasonable it is to assume that the choice of language should affect inference. 
While it may indeed seem reasonable to assume that the choice of language should affect 
inference, we point out that this assumption has some consequences that some might view 
as unfortunate. In Section 6, we discuss how limited forms of representation independence 
can be achieved. We discuss related work in Section 7, and conclude in Section 8. 

2. Probabilistic Inference 

We begin by defining probabilistic inference procedures. As we discussed in the introduction, 
there are two quite different ways in which this term is used. In one, we are given a prior 
distribution over some probability space; our "knowledge" then typically consists of events 
in that space, which can be used to condition that distribution and obtain a posterior. In 
the other, which is the focus of our work, a probabilistic inference procedure takes as input 
a probabilistic knowledge base and returns a probabilistic conclusion. 

We take both the knowledge base and the conclusion to be assertions about the proba- 
bilities of events in some measurable space (X, Tx ) , where a measurable space consists of a 
set X and an algebra Tx of subsets of X (that is, Tx is a set of subsets of X closed under 
union and complementation, containing X itself). 2 Formally, these assertions can be viewed 
as statements about (or constraints on) probability measures on (X, Tx)- For example, if 

2. If X is infinite, we may want to consider countably-additive probability measures and take Tx to be 
closed under countable unions. This issue does not play significant role in this paper. For simplicity, we 
restrict to finite additivity and require only that Tx be closed under finite unions. 
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S G Tx-, a statement Pr(5) > 2/3 holds only for distributions where S has probability 
at least 2/3. Therefore, if Arx,T x ) ls ^ ne se * °^ an probability measures on (X, Tx) (that 
is, all probability measures with domain Tx)-, we can view a knowledge base as a set of 
constraints on Ar x ,F x )- When Tx is clear from context, we often omit it from the notation, 
writing Ax rather than A< X j:\. 

We place very few restrictions on the language used to express the constraints. We 
assume that it includes assertions of the form Pr(S') > a for all subsets S G T x and rational 
a G [0, 1], and that it is closed under conjunction and negation, so that if KB and KB' are 
knowledge bases expressing constraints, then so are KB A KB' and -*KB. (However, the 
langauge could include many assertions besides those obtained by starting with assertions 
of the form Pr(S') > a and closing off under conjunction and negation.) Since the language 
puts constraints on probability measures, we cannot directly say that S G T x must hold. 
The closest approximation in the language is the assertion Pr(5) = 1. Thus, we call such 
constraints objective. A knowledge base consisting of only objective constraints is called an 
objective knowledge base. Since Pr(Ti) = 1 A Pr(T2) = 1 is equivalent to Pr(7\ n T2) = 1, 
without loss of generality, an objective knowledge base consists of a single constraint of the 
form Pr(T) = 1. Given a knowledge base KB placing constraints on Ax, we write \i |= KB 
if /j, is a measure in Ax that satisfies the constraints in KB. We use [KB]x to denote all 
the measures satisfying these constraints. 

In practice, our knowledge is typically represented syntactically, using some logical lan- 
guage to describe the possible states. Typical languages include propositional logic, first- 
order logic, or a language describing the values for some set of random variables. In general, 
a base logic C defines a set of formulas £($) f° r a given vocabulary <I>. In propositional 
logic, the vocabulary $ is simply a set of propositional symbols. In probability theory, the 
vocabulary can consist of a set of random variables. In first-order logic, the vocabulary is a 
set of constant symbols, function symbols, and predicate symbols. To facilitate comparison 
between vocabularies, we assume that for each base logic all the vocabularies are finite 
subsets of one fixed infinite vocabulary 

When working with a language, we assume that each state in the state space defines 
an interpretation for the symbols in <3? and hence for the formulas in £($). In the case of 
propositional logic, we thus assume that we can associate with each state a truth assignment 
to the primitive propositions in <!>. For first-order logic, we assume that we can associate 
with each state a domain and an interpretation of the symbols in In the probabilistic 
setting, we assume that we can associate with each state an assignment of values to the 
random variables. It is often convenient to assume that the state space is in fact some 
subset W of W(3>), the set of all interpretations for (or assignments to) the vocabulary $. 
Note that the truth of any formula ip in is determined by a state. If ip is true in some 
state w, we write w\= <p. 

The probabilistic extension £ pr (&) of a base logic is simply the set of probability 

formulas over £(&)■ Formally, for each (p G £($), Pr(<^) is a numeric term. The formulas in 
C pr (&) are defined to be all the Boolean combinations of arithmetic expressions involving 
numeric terms. For example, Pr(fly \ bird) > 1/2 is a formula in C pr ({fly , bird}) (where 
we interpret a conditional probability expression Pr(</? | ip) as Pr(ip A ip)/Pr(ip) and then 
multiply to clear the denominator). By analogy with constraints, a formula of the form 
Pr(<y?) = 1 is called an objective formula. 
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Given a set W C W(<I>), assume that Tw is the algebra consisting of all sets of the 
form \tp\w = {w : w \= (p}, for 92 G £($). (In the case of propositional logic, where $ 
consists of a finite set of primitive propositions, T~w = 2 W ■ In the case of first-order logic, 
not all sets are necessarily definable by formulas, so Tw may be a strict subset of 2 W .) 
Let n be a probability measure on (W, Fw)- We can then ascribe semantics to £ pr ((fr) in 
the probability space {W,J-w-,n) in a straightforward way. In particular, we interpret the 
numeric term Pr(<^) as n({w G W : w \= </?}). Since a formula (p G £(<!>) describes an event 
in the space W, a formula 9 in £ pr (&) is clearly a constraint on measures on W. We write 
fi \= 9 if the measure G A^y satisfies the formula #. 

A syntactic knowledge base KB G £ pr ($) can be viewed as a constraint on Ayj/ in an 
obvious way. Formally, KB represents the set of probability measures [A5]<|> Q ^-w, which 
consists of all measures n on W such that n \= KB. 

We say that KB (whether syntactic or semantic) is consistent if [KB]x 7^ 0, i.e., if 
the constraints are satisfiable. Finally, we say that KB entails 9 (where 9 is another set of 
constraints on Ax), written KB \=x 9, if [ifBjx Q {9}x, i-e., if every measure that satisfies 
KB also satisfies 9. We write \=x 9 if is satisfied by every measure in Ax- We omit the 
subscript X from |= if it is clear from context. 

Entailment is well-known to be to be a very weak method of drawing conclusions from 
a knowledge base, in particular with respect to its treatment of irrelevant information. 
Consider the knowledge base consisting only of the constraint Pr(fly \ bird) > 0.9. Even 
though we know nothing to suggest that red is at all relevant, entailment will not allow us 
to reach any nontrivial conclusion about Vx{fly \ bird A red). 

One way to get more powerful conclusions is to consider, not all the measures that satisfy 
KB, but a subset of them. Intuitively, given a knowledge base KB, an inference procedure 
picks a subset of the measures satisfying KB, and infers 9 if 9 holds in this subset. Clearly, 
more conclusions hold for every measure in the subset than hold for every measure in the 
entire set. 

Definition 2.1: An (X, Tx) -inference 'procedure is a partial function / : 2 A(x - ?r x) 1— > 
2 A (*.^x) such that 1(A) C A for A C A {X ,F X ) and 1(A) = iff A = for all A G 2^ x ^x) in 
the domain of / (i.e., for all A for which / is defined). We write KB |- / 9 if I(\KB\ X ) C \9\ x . 
I 

When Tx is clear from context or irrelevant, we often speak of A-inference procedures. 
We remark that Paris (1994) considers what he calls inference processes. These are just 
inference procedures as we have defined them that, given a a set A of probability measures, 
return a unique probability measure in A (rather than an arbitrary subset of ^4). Paris 
gives a number of examples of inference processes. He also considers various properties that 
an inference process might have. Some of these are closely related to various properties of 
representation indepedence that we consider. We discuss Paris's work in Section 7. 

Entailment is the A-inference procedure defined on all sets determined by taking I to 
be the identity. Maximum entropy is also an inference procedure in this sense. 

Definition 2.2: Given a probability measure [i on a finite space A (where all sets are 
measurable), its entropy H(/j>) is defined as — X^ex / u ( x ) 1°§ (The log is taken to the 
base 2 here.) Given a set A of measures in Ax, let I'x e (A) consist of the measures in A 
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that have the highest entropy if there are measures in A whose entropy is at least as high 
as that of any measure in A; if there are no such measures, inf me (yl) is undefined. I 

It is easy to see that inf me (yl) is defined if A is closed (in the topological sense; i.e., if 
fi n is a sequence of probability measures in A and fi n converges to fi, then \x £ A). Thus, 
we could take the domain of inf™ e to consist only of the closed sets of measures in Ax- 
There are also open sets A for which inf me (A) is defined, although it is not defined for all 
open sets A. For example, suppose X = {x\,X2} and let A = {fi : n{x\) < 1/2}. Let 
be such that Ho(xi) = 1/2. It is easy to check that H(fio) = 1, and H(fi) < 1 for fi G A. 
However, for all e, there is some \i € A such that H(n) > 1 — e. It follows that there is no 
measure in A whose entropy is higher than that of any other measure in A, so mf me (A) is 
undefined. On the other hand, if A' = {// : fi(xi) < 2/3}, then there is a measure whose 
entropy is maximum in the open set A', namely the measure fiQ. 

There are, of course, many inference procedures besides entailment and maximum en- 
tropy that can be defined on a measurable space. In fact, as the following proposition shows, 
any binary relation |~ satisfying certain reasonable properties is an inference procedure of 
this type. 

Proposition 2.3: If I is an X -inference procedure then the following properties hold for 
every KB, KB',9,ip over X such that KB is in the domain of I. 

• Reflexivity: KB ^ KB. 

• Left Logical Equivalence: if KB is logically equivalent to KB', i.e., if \= KB <£4> KB' , 
then for every 9 KB^j9 iff KB' 0. 

• Right Weakening: if KB f^ 7 9 and \= =>■ ip then KB |~ 7 ip. 

• And: if KB f- 7 and KB f- 7 tp, then KB (- 7 9 A tp. 

• Consistency: if KB is consistent then KB false. | 

Proof: Straightforward from the definitions. I 

Interestingly, these properties are commonly viewed as part of a core of reasonable 
properties for a nonmonotonic inference relation (Kraus, Lehmann, & Magidor, 1990). 

We would like to also prove a converse, showing that any relation |~ over probabilistic 
constraints on some space X that satisfies the five properties above must have the form 
f^j ■ This is not quite true, as the following example shows. 

Example 2.4: Fix a measurable space (X, Tx)- Let the language consist of all (finite) 
Boolean combination of statements of the form Pr(S') > a, where S £ Tx- Now fix one 
nonempty strict subset So of X, and let ip n be the statement Pr(So) < 1/n. Define an 
inference procedure |~ as follows. If KB is not equivalent to true (i.e, if ^ Ax), 

then KB |~ 9 iff KB (= 0. On the other hand, true |~ 9 iff ip n \= 9 for all sufficiently large 
n. That is, true \^9 if there exists an iV such that for all n > N, we have <p n \= 9. It is 
easy to check that all five properties in Proposition 2.3 hold for |~. However, |~ is not 
for an X-inference procedure /. For suppose it were. Note that (p n \= (p m for all n > m, 
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so true f° r an m - Thus, we must have /(Ax) C [<£> n ]x for all n. It follows that 

7 X (A X ) C [Pr(5 ) = 0] x , and so irue f- 7 Pr(S ) = 0. However, ip n \fc Pr(S) = for any n, 
so we do not have true |~ Pr(S') = 0. This contradicts the assumption that (~ = I 

Essentially what we need to get the converse to Proposition 2.3 is an infinitary version of 
the And Rule, which would say that if KB 9; t for all i, then KB /\ { 9{. If the language 
were closed under infinite conjunctions, then this rule would in fact be just what we need. 
Since we have not assumed that the language is closed under infinite conjunctions, we use 
a variant of this rule. 

• Infinitary And: For any set £ of statements, if KB |~ 7 9 for all 9 € £ and £ |= ip, 
then KB ip. 

Proposition 2.5: Lei |~ be a relation over probabilistic constraints on X for which the 
properties Reflexivity, Left Logical Equivalence, Right Weakening, Infinitary And, and Con- 
sistency hold for all KB in the domain of |~ . (That is, if KB is in the domain of |~ in 
that KB |~ 9 for some 9, then KB KB, and so on.) Then j~ is |~ 7 for some X -inference 
procedure I. 

Proof: See Appendix A.l. I 

We are typically interested not just in an inference procedure defined on one space X, 
but in a family of related inference procedures, defined on a number of spaces. For example, 
entailment is an inference procedure that is defined on all spaces X; maximum entropy is 
defined on all finite measurable spaces (X, 2 X ) . 

Definition 2.6 : If X is a set of measurable spaces, an X -inference procedure is a set 
{I(x,T x ) : {X,Tx) G X}, where I(x,T x ) ls an (A, J r x)-inference procedure for (X, Tx) £ 
I 

We sometimes talk about an ^-inference procedure /, and write KB 9 when {X, Tx) G 
X is clear from context. However, it should be stressed that, formally, an ^-inference pro- 
cedure is a really a set of inference procedures (typically related in some natural way). 

Clearly entailment is an A'-inference procedure for any X, where Ix is simply the identity 
function for X G X. If X consists of finite measurable spaces where all sets are measurable, 
then maximum entropy is an X -inference procedure. We typically denote this inference 
procedure f^ me . Thus, KB \^ me 9 if 9 holds for all the probability measures of maximum 
entropy satisfying KB. 

Important assumptions: For the remainder of this paper, we deal only with X- 
inference procedures I for which X satisfies two richness assumptions. These assumptions 
hold for all the standard inference procedures that have been considered. 

• We assume that X is closed under crossproducts, so that if (X , Tx) , (Y, Ty) € X, 
then (X x Y,Txxy) £ X, where FxxY is the algebra formed by taking finite unions 
of disjoint sets of the form S x T, for S € Tx an d T € Ty. It is easy to see that 
this is an algebra, since S xT = S x T U S x T U S x T and (S x T) n (S' x T') = 
(S n S') x (T n T') (from which it also follows that any union of such sets can be 
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written as a disjoint union). Note that if X and Y are finite sets, Tx = 2 , and 
Ty = 2 Y , then J^xfy = 2 Xx7 . As we shall see, having (X x Y, Fxxy) & X if each 
of (A, Tx) and (Y, Ty) is in <Y allows us to relate constraints on X to constraints on 
Y in a natural way. 

• We assume that X contain sets of all finite cardinalities; more precisely, for all n > 2, 
there exists a set (X,Tx) € X such that \X\ = n and Tx = 2 X ■ This assumption 
is not actually needed for any of our results, since the assumption that X is closed 
under crossproducts already implies that, for any finite re, there exists a measurable 
space (X, Tx) £ X such that \X\ > n; this already suffices to prove all the results 
of the paper. However, assuming that X has sets of all cardinalities does make the 
proofs easier. 

We also want the domain of I to satisfy certain assumptions, but we defer stating these 
assumptions until we have introduced some additional definitions and notation. 

3. Robustness 

In order to define robustness to representation shifts, we must first define the notion of 
a representation shift. Our first attempt at this definition is based on the idea of using 
constraints that specify the relationship between the two vocabularies. For example, in Ex- 
ample 1.1, we might have X = {colorful, colorless} and Y = {red, blue, green, colorless}. We 
can specify the relationship between X and Y via a constraint that asserts that colorful <3> 
(red V blue V green). 

Of course, not every constraint is a legitimate mapping between representations. For 
example, a formula that asserted ^colorful is obviously not a legitimate representation 
shift. At a minimum, we must assume that the constraint does not give any additional 
information about X as far as logical inference goes. At a syntactic level, we can use the 
following definition. Given a knowledge base KB € C pr (<&), we say that ip € C pr (<& U <&') is 
<£- conservative over KB if, for all formulas <p € £ pr (&), we have KB \= ip iff KB Aip \= <p. 
Thus, adding ip to the knowledge base does not permit any additional logical inferences 
in the vocabulary <E>. An inference procedure I is robust if it is unaffected by conservative 
extensions; that is, if KB,(p G £ pr (&), then KB \^jtp iff KB A tp K'/ ( / 3 f° r ah 1 that are 
^-conservative over KB. Roughly speaking, this says that getting new information that is 
uninformative as far as logical inference goes does not affect default conclusions. 

The formal definition of robustness, which uses semantic rather than syntactic concepts, 
extends these intuitions to arbitrary constraints on measures (not just ones that can be 
expressed in the language C pr ). 

Definition 3.1: For fi <E A XlX ...xX n , define p, Xl G A Xi by taking Hx^A) = fi(X 1 x • • • x 
Xi-i x A x Xi + \ x • • • x X n ). A constraint ip on Ajq can be viewed as a constraint on 
^Xix...xX„ by taking [y]xix...xx„ X...XA„ 

: fi Xi \= ¥>}■ We frequently identify 
constraints on Aj with constraints on 1] x ... x X n in this way. For B C Ax 1 x—xX n , define 
proj x -(B) = {^x t ■ M £ B}. A constraint ip on Ax 1 x—xX n is said to be AV conservative 
over the constraint KB on A Xi if proj Xx (\KB A x- -xX n ) = {KB\ Xl . I 
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To see that this definition generalizes the earlier language-oriented definition, note that 
if ip and KB are constraints on Ax and ip is a constraint on AxxY, then KB A ip \= (p iff 
proj^fKB A Vkxy) C fo,]*, while tffl |= <p iff C fo,]*. 

Definition 3.2: {Ix ■ X G X} is a robust X -inference procedure if for all spaces X, Y G X, 
constraints KB and <p on Ax, and constraints ip on AxxY that are A-conservative over 
KB, we have KB \^j x l f iff KB A -0 |~ Jjf (Note that this definition implicitly assumes 
that X x Y G A? if X, Y G Af, an assumption we made explicit earlier.) | 

At first glance, robustness might seem like a reasonable desideratum. After all, why 
should adding a constraint on AxxY that places no restrictions on Ax change the con- 
clusions that we might reach about X? Unfortunately, it turns out that this definition 
is deceptively strong, and disallows any "interesting" inference procedures. In particular, 
one property we may hope for in an inference procedure is to draw nontrivial conclusions 
about probabilities of events, that is, conclusions that do not follow from entailment. For 
example, maximum entropy (or any inference procedure based on symmetry) will conclude 
Pi(p) = 1/2 from the empty knowledge base. We can show that inference procedures 
that are robust do not really allow much in the way of nontrivial conclusions about the 
probabilities of events. 

Definition 3.3: An (X, jFx)-inference procedure I is essentially entailment for the knowl- 
edge base KB C A x if for all S G Tx, if KB ^ a < Pr(S") < /3 then KB \= a < Pr(S) < (3. 
I is essentially entailment for X if it is essentially entailment for all knowledge bases KB 
in the domain of Ix- I 

Thus, when entailment lets us conclude Pr(S') £ [a, 0\, an inference procedure that is 
essentially entailment lets us draw only the slightly stronger conclusion Pr(5) <G {a,/3). To 
prove this, we need to make three assumptions about the domain of /. (For other results, 
we need other assumptions about the domain of I.) 

DI1. a < Pi(S) < (3 is in the domain of I(x,F x ) for all S G J-x, a,/3 E JR. 

DI2. If KB is in the domain of Ix, then it is also in the domain of IxxY (when KB is 
viewed as a constraint on AxxY-) 

DI3. If KB i and KB 2 are in the domain of Ix, then so is KB\ A KB2- 

Note that sets of the form a < Pr(5) < (3 are closed sets. It certainly seems reasonable 
to require that such sets be in the domain of an inference procedure; they correspond to 
the most basic observations. DI2 seems quite innocuous; as observed earlier, we do want 
to be able to view constraints on Ax as constraints on AxxY, and doing so should not 
prevent them from being in the domain of /. DI3 also seems to be a reasonable assumption, 
since if KB\ and KB2 correspond to possible observations, we want to be able to draw 
conclusions from combining the observations. DI3 holds if the domain of / consists of 
closed sets. But note that it does not hold for I me if we take its domain to consist of 
all sets that have a measure whose entropy is maximum. For example, if X = {xi,X2}, 
A = {/io} U {[i : ju(xi) > 3/4}, and B = {/j, : /x(a?i) > 2/3}, where Ho{xo) = 1/2, then each 
of A and B have a measure whose entropy is maximum, but A n B does not have a measure 
whose entropy is maximum. 
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Theorem 3.4: If {Ix ■ X G X} is a robust X -inference procedure that satisfies DI1, DI2, 
and DI3, then Ix is essentially entailment for all X £ X. 

Proof: See Appendix A. 2. | 

It is possible to construct robust inference procedures that are almost but not quite 
entailment, simply by "strengthening" some conclusions from Pr(5) G [a, (3] to Pr(5) G 
(a,f3). Clearly, however, any robust inference procedure is extremely limited in its ability 
to jump to conclusions. In the next section, we look at a definition that seems closer to 
the intuitive notion of representation independence, and has somewhat more reasonable 
consequences. 

4. Representation Independence 
4.1 Representation shifts 

If X and Y are two different representations of the same phenomena then, intuitively, 
there should be a way of relating states in X to corresponding states in Y. We want this 
correspondence to respect the logical structure of events. Formally, we require that it be a 
homomorphism with respect to complementation and intersection. 

Definition 4.1: An (X, Tx)-(Y, Ty) embedding f is a function / : Tx l— * 3~Y such that 
f(S U T) = f(S) U f(T) and f(S) = J(S) for all S, T G T x . I 

As elsewhere, we talk about X-Y embeddings rather than (X,Tx)-(Y,Ty) embeddings if 
Tx and Ty do not play a significant role. 

Our goal is to consider the effect of a transformation on probabilistic formulas. Hence, 
we are interested in sets of states and their probabilities. 

Definition 4.2: If / is an X-Y embedding, jjl G Ax, and v G Ay, then /x and v correspond 
under f if fi(S) = v(f(S)) for all events S G Tx- We define a mapping /* : 2 Ax i— > 2 Ay as 
follows. We first define /* on singleton sets (except that, for convenience, we write f*(p) 
rather than f*({n}) by taking f*(fi) = {u G Ay : u(f(S)) = n(S) for all S G T x }- Thus, 
consists of all measures in Ay that correspond to /x under /. If V is an arbitrary 
subset of 2 Ax , define f*{V) = U^vf*^) for V C A*. I 

If is a constraint on Ax expressed in some language, we typically write f*{6) rather than 
/*([0]x)- We implicitly assume that the language is such that the constraint f*{6) is also 
expressible. It is not hard to see that f*(0) is the constraint that results by replacing every 
set S G Tx that appears in 9 by f(S). 

Example 4.3: In Example 1.1, we might have X = {colorful, colorless} and Y = {red, blue, 
green, colorless}. In this case, we might have f (colorful) = {red, blue, green} and f (colorless) = 
{colorless}. Consider the measure fi G Ax such that fi(colorful) = 0.7 and ^(colorless) = 
0.3. Then /*(//) is the set of measures v such that the total probability assigned to the set of 
states {red, blue, green} by v is 0.7. Note that there are uncountably many such measures. 
It is easy to check that if 9 is a constraint on Ax such as Pr (colorful) > 3/4, then f*(9) is 
Pr ({red, blue, green}) > 3/4. | 
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Embeddings can be viewed as the semantic analogue to the syntactic notion of inter- 
pretation defined in (Enderton, 1972, pp. 157-162), which has also been used in the recent 
literature on abstraction (Giunchiglia & Walsh, 1992; Nayak & Levy, 1995). Essentially, 
an interpretation maps formulas in a vocabulary <E> to formulas in a different vocabulary 
^ by mapping the primitive propositions in $ (e.g., colorful) to formulas over (e.g., 
red V blue V green) and then extending to complex formulas in the obvious way. The repre- 
sentation shift in Example 1.2 can also be captured in terms of an interpretation, this one 
taking flying-bird to fly A bird. 

Definition 4.4: Let $ and ^ be two vocabularies. In the propositional case, a interpre- 
tation of <3? into ^ is a function i that associates with every primitive proposition p G <3? 
a formula i(p) G A more complex definition in the same spirit applies to first-order 

vocabularies. For example, if R is a k-ary predicate, then i(R) is a formula with k free 
variables. I 

Given an interpretation i, we get a syntactic translation from formulas in £(<!>) to formulas 
in £(*&) using i in the obvious way; for example, i((p A —*q) V r) = (i(p) A —>i(q)) V i(r) 
(see (Enderton, 1972) for the details). Clearly an interpretation i from <I> to induces an 
embedding / from W\ C W($) to W 2 C W(*): we map \tp\wi to P(^)]w 2 - 

Of course, not all embeddings count as legitimate representation shifts. For example, 
consider an embedding / defined in terms of an interpretation that maps both the propo- 
sitions p and q to the proposition r. Then the process of changing representations using 
/ gives us the information that p and q are equivalent, information that we might not 
have had originally. Intuitively, / gives us new information by telling us that a certain 
situation — that where p A —>q holds — is not possible. More formally, the embedding / 
has the following undesirable property: it maps the set of states satisfying p A —>q to the 
empty set. This means a state where p A ->q holds does not have an analogue in the new 
representation. We want to disallow such embeddings. 

Definition 4.5: An X-Y embedding / is faithful if, for all S,T G Tx, we have S C T iff 
f(S) C f(T). | 

This definition has the desired consequence of disallowing embeddings that give new 
information as far as logical consequence goes. 

Lemma 4.6: An X-Y embedding f is faithful if and only if for all constraints KB and 6, 
we have KB \= 9 iff f* (KB) \= f*{6). 

Proof: See Appendix A. 3. | 

It is clear that our embedding from Example 4.3 is faithful: f (colorful) = {red, blue, green} 
and f (colorless) = colorless. The following proposition gives further insight into faithful 
embeddings. 

Proposition 4.7: Let f be a faithful X-Y embedding. Then the following statements are 
equivalent: 

(a) n and v correspond under f ; 
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(b) for all formulas 6, fi \= 6 iff v \= f*{9). 
Proof: See Appendix A. 3. I 

If the embedding / is a "reasonable" representation shift, we would like an inference 
procedure to return the same answers if we shift representations using /. 

Definition 4.8: If X, Y G X, then the ^-inference procedure {Ix '■ X G X} is invariant 
under the X-Y embedding / if for all constraints KB and 9 on Ax, we have KB \^j x iff 
f*(KB) |~j /*(#)■ (Note that, in particular, this means that KB is in the domain of \^ j 
iff f*(KB) Is in the domain of f~ /yr .) | 

Definition 4.9: The ^-inference procedure {Ix '■ X G X} is representation independent if 
it is invariant under all faithful X-Y embeddings for all X, Y G X. | 

Since the embedding for Example 4.3 is faithful, any representation-independent infer- 
ence procedure would return the same answers for Pv(colorful) as for Pr(red V blue V green). 
The issue is somewhat more subtle for Example 1.2. There, we would like to have an em- 
bedding / generated by the interpretation i(flying-bird) = fly A bird and i(bird) = bird. 
This is not a faithful embedding, since flying-bird =^ bird is not a valid formula, while 
i(flying-bird =^ bird) is {fly A bird) =4* bird which is valid. Looking at this problem seman- 
tically, we see that the state corresponding to the model where flying-bird A -^bird holds is 
mapped to 0. But this is clearly the source of the problem. According to our linguistic intu- 
itions for this domain, this is not a "legitimate" state. Rather than considering all the states 
in W ({flying-bird, bird}), it is perhaps more appropriate to consider the subset X consist- 
ing of the truth assignments characterized by the formulas {flying-bird A bird, ^flying-bird A 
bird, ^flying-bird A ^bird}. If we now use i to embed X into W({fly, bird}), the result- 
ing embedding is indeed faithful. So, as for the previous example, invariance under this 
embedding would guarantee that we get the same answers under both representations. 

4.2 Representation-independent inference procedures 

Although the definition of representation independence seems natural, so did the definition 
of robustness. How do the two definitions relate to each other? First, we show that rep- 
resentation independence is a weaker notion than robustness. For this result, we need to 
consider inference procedures that satisfy two further assumptions. 

DI4. If / is a faithful X-Y embedding, then KB is in the domain of Ix iff f*(KB) is in the 
domain of ly . 

DI5. If KB is in the domain of IxxY, / is a faithful X-Y embedding, and ipi is a constraint 
on Ax, then KB A (ipi <^4> f*(ipi)) is in the domain of IxxY- 

DI4 is very natural and is satisfied by all the standard inference procedures. It is easy to 
check that if KB is closed iff f*(KB) is closed. While DI5 may not appear so natural, it 
does hold for domains consisting of closed sets, since it is not hard to check that (p 44> f*(fi) 
is closed. DI5 would follow from DI3 and the assumption that if 44> /*(</?i) is in the domain 
of IxxY, but it is actually weaker than the combination of these two assumptions. In 
particular, it holds for the domain consisting of all sets on which there is a measure of 
maximum entropy. 
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Theorem 4.10: // an X -inference procedure is robust that satisfies DI2, DI4, and DI5, 
then it is representation independent. 

Proof: See Appendix A. 3. I 

We have already shown that any robust inference procedure must be almost trivial. Are 
there any interesting representation-independent inference procedures? As we shall see, the 
answer is mixed. There are nontrivial representation-independent inference procedures, but 
they are not very interesting. 

Our first result shows that representation independence, like robustness, trivializes the 
inference procedure, but only for some knowledge bases. 

Theorem 4.11: If {Ix ■ X € X} is a representation-independent X -inference procedure 
then, for all X € X , Ix is essentially entailment for all objective knowledge bases in its 
domain? 

Proof: See Appendix A. 3. | 

Corollary 4.12: If {Ix '■ X G X} is a representation-independent X-inference procedure, 
KB is objective, and KB \^ T a < Pr(5) < (3 for some a > and < 1, then a = and 
(3 = 1. 

This result tells us that from an objective knowledge base Pr(T) = 1, we can reach only 
three possible conclusions about a set S. If T C S, then we can conclude that Pr(5) = 1; 
if T C S, then we can conclude that Pr(S') = 0; otherwise, the strongest conclusion we can 
make about Pr(S') is that is somewhere between and 1. 

We can construct a representation-independent inference procedure that is not entail- 
ment and has precisely this behavior if we restrict attention to countable state spaces. Sup- 
pose that X is countable. Given an objective knowledge base KB of the form Pr(T) = 1, 
where T G Tx, let KB + consist of all formulas of the form < Pr(S') < 1 for for 
all nonempty strict subsets S of T in J-x- 4 We now define an A-inference procedure 
I x as follows: If KB is equivalent to an objective knowledge base, then KB \-^ I0 ip if 
KB A KB + \= p; if KB is not equivalent to an objective knowledge base, then KB |~ J0 (p if 
KB \= p. It follows easily from Proposition 2.5 that I x is indeed an inference procedure. 
Moreover, it is not equivalent to the standard notion of entailment; for example, we have 
true |~j < Pr(p) < 1, while ^=0 < Pr(p) < 1. Nevertheless, we can prove that 1° is 
representation independent. 

Lemma 4.13: Let X consist of only countable sets. Then {I x : X € X} is a representation- 
independent X-inference procedure. 

3. In an earlier version of this paper (Halpern & Roller, 1995), we claimed that any representation- 
independent inference procedure that satisfied a minimal irrelevance property (implied by robustness, 
but not equivalent to it) is essentially entailment for all knowledge bases. As Jaeger (1996) shows, an 
inference procedure along the lines of I 1 described below can be constructed to show that this result is 
not correct. We seem to need the full strength of robustness. 

4. The requirement that X be countable is necessary here. If X is uncountable and every singleton is in Tx , 
then KB + is inconsistent if both T and T are uncountable. It is impossible that each of an uncountable 
collection of points has positive measure. 
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Proof: See Appendix A. 3. I 

While objective knowledge bases may not appear so interesting if we restrict to prepo- 
sitional languages, for languages that include first-order and statistical information they 
become quite interesting. Indeed, as shown in (Bacchus, 1990; Bacchus, Grove, Halpern, & 
Roller, 1996), knowledge bases with first-order and (objective) statistical information allow 
us to express a great deal of the information that we naturally encounter. For example, we 
can express the fact that "90% of birds fly" as an objective statement about the number of 
flying birds in our domain relative to the overall number of birds. Of course, Theorem 4.11 
applies immediately to such knowledge bases. 

Theorem 4.11 also implies that various inference procedures cannot be representation 
independent. In particular, since true f^ me Pr(p) = 1/2 for a primitive proposition p, it 
follows that maximum entropy is not essentially entailment. This observation provides 
another proof that maximum entropy is not representation independent. 

It is consistent with Theorem 4.11 that there are representation-independent inference 
procedures that are not almost entailment for probabilistic knowledge bases. For example, 
consider the X-inference procedure I x defined as follows. Given A C Ax, if there exists 
some S G T x such that A = {ji G A x : fJ,(S) > 1/4}, then I X (A) = {/ieA x : n(S) > 1/3}; 
otherwise, I X {A) = A. Thus, Pr(5) > 1/4 Pr(5) > 1/3. Clearly, l\ is not essentially 
entailment. Yet, we can prove the following result. 

Lemma 4.14: Suppose that X consists only of measure spaces of the form (X,2 X ), where 
X is finite. Then {I x : X G X} is a representation-independent X -inference procedure. 

Proof: See Appendix A. 3. | 

Note that it follows from Theorem 3.4 that I 1 cannot be robust. Thus, we have shown 
that representation independence is a strictly weaker notion than robustness. 

This example might lead us to believe that there are representation-independent infer- 
ence procedures that are "interesting" for probabilistic knowledge bases. However, as we 
now show, a representation-independent inference procedure cannot satisfy one key desider- 
atum: the ability to conclude independence by default. For example, an important feature of 
the maximum-entropy approach to nonmononotic reasoning (Goldszmidt, Morris, & Pearl, 
1993) has been its ability to ignore "irrelevant" information, by implicitly assuming in- 
dependence. Of course, maximum entropy does not satisfy representation independence. 
Our result shows that no approach to probabilistic reasoning can simultaneously assure 
representation independence and a default assumption of independence. 

We do not try to give a general notion of "default assumption of independence" here, 
since we do not need it for our result. Rather, we give a minimal property that we would 
hope an inference procedure might have, and show that this property is sufficient to preclude 
representation independence. Syntactically, the property we want is that if <& and ^ are 
disjoint vocabularies, KB G £ pr (®), (p G £($), and ip G £(*), then KB f~jPr(<£ A ip) = 
Pr(V) x Pr(V>). 
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Definition 4.15: An X -inference procedure {Ix '■ X G X} enforces minimal default inde- 
pendence if, whenever X and Y are in X, KB is a constraint on Ax in the domain of , 
S G F x , and T G Ty, then KB \^ IxxY Pr(S x T) = Pr(5) x Pr(T). 5 I 

This definition clearly generalizes the syntactic definition. 

Clearly, entailment does not satisfy minimal default independence. Maximum entropy, 
however, does. Indeed, a semantic property that implies minimal default independence is 
used by Shore and Johnson (1980) as one of the axioms in an axiomatic characterization of 
maximum-entropy. 

Theorem 4.16: If {Ix '■ X G X} is an X -inference procedure that enforces minimal default 
independence and satisfies DI1, then Ix is not representation independent. 

Proof: See Appendix A. 3. I 

This result is very interesting as far as irrelevance is concerned. We might hope that 
learning irrelevant information does not affect our conclusions. While we do not attempt 
to define irrelevance here, certainly we would expect that if KB' is in a vocabulary disjoint 
from KB and ip, then, for example, KB f- / Pi(ip) = a iff K B A KB' f- / Pr(<p) = a. If KB' 
is objective, then the standard probabilistic approach would be to identify learning KB' 
with conditioning on KB'. Suppose that we restrict to inference procedures that do indeed 
condition on objective information (as is the case for the class of inference procedures we 
consider in Section 6). Then KB A KB' f- / Pr(^) = a exactly if KB h/Pr^ I KB') = «• 
Thus, Theorem 4.16 tells us that inference procedures that condition on new (objective) 
information cannot both be representation independent and ignore irrelevant information. 

Thus, although representation independence, unlike robustness, does not force us to use 
entirely trivial inference procedures, it does prevent us from using procedures that have 
certain highly desirable properties. 

5. Discussion 

These results suggest that any type of representation independence is hard to come by. They 
also raise the concern that perhaps our definitions were not quite right. We can provide 
what seems to be even more support for the latter point. 

Example 5.1: Let Q be a unary predicate and c\, . . . , cioo, d be constant symbols. Suppose 
that we have two vocabularies <I> = {Q,d} and \l/ = {Q, c±, . . . , cioo, d}. Consider the 
interpretation i from $ to ^ for which i{d) = d and i(Q(x)) = Q(x) A Q{c\) A ... A Q(cioo)- 
Now, consider KB = 3xQ(x). In this case, i{KB) = 3x(Q(x) A Q(c\) A ... A Q(cioo)- 
Intuitively, since all the Cj's may refer to the same domain element, the only conclusion we 
can make with certainty from Q{c\) A . . . A Q(cioo) is that there exists at least one Q in the 
domain, which gives us no additional information beyond KB. We can convert this example 
into a general argument that the embedding / corresponding to i is faithful. Intuitively, for 

5. Since we are working in the space X x Y, KB should be viewed as a constraint on Axxy here, Pr(S') 
should be understood as Pr(S x Y), while Pr(T) should be understood as Pr(X x T). Recall that, by 
assumption, X x Y G X. 
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any KB, we can only get the conclusion Q(c\) A ... A Q( c ioo) from f*{KB) if Q(x) appears 
positively in KB; but, in this case, we already know that there is at least one Q, so we 
gain no new information from the embedding. But it does not seem unreasonable that an 
inference procedure should assign different degrees of belief to Q(d) given KB = 3xQ(x) on 
the one hand and given i( K B) = 3x(Q(x) A Q(c±) A . . . AQ(cioo)) on the other, 6 particularly 
if the domain is small. In fact, many reasoning systems explicitly adopt a unique names 
assumption, which would clearly force different conclusions in these two situations. | 

This example suggests that, at least in the first-order case, even faithful embeddings 
do not always match our intuition for a "reasonable" representation shift. One might 
therefore think that perhaps the problem is with our definition even in the propositional 
case. Maybe there is a totally different definition of representation independence that avoids 
these problems. While this is possible, we do not believe it to be the case. The techniques 
that we used to prove Theorem 4.16 and 3.4 seem to apply to any reasonable notion of 
representation independence. 7 To give the flavor of the type of argument used to prove these 
theorems, consider Example 1.1, and assume that true |~ 7 Pr(colorful) = a for a € (0, l). 8 
Using an embedding g such that g(colorful) = red, we conclude that true |~ 7 Pr(rai) = a. 
Similarly, we can conclude Pr(blue) = a and Pr(green) = a. But in order for |~j to be 
invariant under our original embedding, we must have true |~j Pr(red V blue V green) = a, 
which is completely inconsistent with our previous conclusions. But the embeddings we use 
in this argument are very natural ones; we would not want a definition of representation 
independence that disallowed them. 

These results can be viewed as support for the position that representation dependence 
is justified; the choice of an appropriate representation encodes significant information. In 
particular, it encodes the bias of the knowledge-base designer about the world. Researchers 
in machine learning have long realized that bias is an inevitable component of effective 
inductive reasoning (i.e., learning from evidence). So we should not be completely surprised 
if it turns out that other types of leaping to conclusions (as in our context) also depend on 
the bias. 

But we need to be a little careful here. For example, in some cases we can identify 
the vocabulary (and hence, the representation) with the sensors that an agent has at its 
disposal. It may not seem that unreasonable that an agent with a temperature sensor and 
a motion sensor might carve up the world differently from an agent with a color sensor 
and a distance sensor. But consider two agents with different sensors who have not yet 
made any observations. Suppose that both of them can talk about the distance to a tree. 
Is it reasonable that the two agents should reach different conclusions about the distance 
just because they have different sensors (and thus use different vocabularies), although they 
have not made any observations? It would then follow that the agents should change their 
conclusions if they switched sensors, despite not having made any observations. This does 
not seem so reasonable! 

Bias and representation independence can be viewed as two extremes in a spectrum. 
If we accept that the knowledge base encodes the user's bias, there is no obligation to be 

6. Actually, i(Q(d)) = Q(d) A Q(ci) A ... A Q(cioo), but the latter is equivalent to Q(d) given KB. 

7. They certainly applied to all of the many definitions that we tried! 

8. In fact, it suffices to assume that true |~ 7 Pr(colorful) € [a, (3], as long as a > or /3 < 1. 
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invariant under any representation shifts at all. On the other hand, if we assume that the 
representation used carries no information, coherence requires that our inference procedure 
give the same answers for all "equivalent" representations. We believe that the right an- 
swer lies somewhere in between. There are typically a number of reasonable ways in which 
we can represent our information, and we might want our inference procedure to return 
the same conclusions no matter which of these we choose. It thus makes sense to require 
that our inference procedure be invariant under embeddings that take us from one reason- 
able representation to another. But it does not follow that it must be invariant under all 
embeddings, or even all embeddings that are syntactically similar to the ones we wish to 
allow. We may be willing to refine colorful to red V blue V green or to define flying-bird 
as fly A bird, but not to transform red to sparrow. In the next section, we show how to 
construct inference procedures that are representation independent under a limited class of 
representation shifts. 

6. Selective invariance 

As discussed above, we want to construct an inference procedure / that is invariant only 
under certain embeddings. For the purposes of this section, we restrict attention to finite 
spaces, where all sets are measurable. That is, we focus on X -inference procedures where 
X consists only of measure spaces of the form (X, 2 X ), where X is finite. 

Our first step is to understand the conditions under which an ^-inference procedure / 
is invariant under a specific X-Y embedding /. When do we conclude 9 from KB C Ax? 
Recall that an inference procedure Ix picks a subset Vx = Ix(KB), and concludes 9 iff 9 
holds for every measure in Vx- Similarly, when applied to f*(KB) C Ay, Iy picks a subset 
Vy = Iy(f*(KB)). For / to be invariant under / with respect to KB, there has to be a 
tight connection between T>x and Vy . 

To understand this connection, first consider a pair of measures /(/ on X and v on Y. 
Recall from Proposition 4.7 that \i and v correspond under / iff, for all formulas 9, we have 
H \= 9 iff v \= f*(9). To understand how the correspondence extends to sets of probability 
measures, consider the following example: 

Example 6.1: Consider the embedding / of Example 4.3, and let T>x = {m,//} where \x 
is as above, and fi' (colorful) = 0.6. How do we guarantee that we reach the corresponding 
conclusions from T>x and Vy! Assume, for example, that Vy contains some measure v 
that does not correspond to either [i or fi' , e.g., the measure that assigns probability 1/4 
to all four states. In this case, the conclusion Vi(colorful) < 0.7 holds in Vx, because it 
holds for both these measures; but the corresponding conclusion P 'r (red V blueM green) < 0.7 
does not hold in Vy. Therefore, every probability measure in Vy must correspond to some 
measure in Vx- Conversely, every measure in T>x must correspond to a measure in T>y. For 
suppose that there is no measure v £ T>y corresponding to [i. Then we get the conclusion 
Pi(blue V red V green) ^ 0.7 from Vy, but the corresponding conclusion Pr(colorful) ^ 0.7 
does not follow from Vx- Note that these two conditions do not imply that Vy must be 
precisely the set of measures corresponding to measures in Vx- In particular, we might have 
Vy containing only a single measure v corresponding to \i (and at least one corresponding 
to fi'), e.g., one with u(red) = 0.5, v(blue) = 0, v(green) = 0.2, and v(colorless) = 0.3. | 
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Based on this example, we use the following extension to our definition of correspon- 
dence. 

Definition 6.2: We say that T>x and Vy correspond under / if for all v £ Vy, there exists 
a corresponding ^ <G T>x (so that /j,(S) = u(f(S)) for all S C X), and for all ^ <G T>x, there 
exists a corresponding v € XV- I 

Proposition 6.3: Suppose that f is a faithful X-Y embedding, T>x <Z Ax, and Vy C Ay. 

The following two conditions are equivalent: 

(a) T>x and Vy correspond under f ; 

(b) for allO, Vx^O iffVy^ r(9) 9 

Proof: See Appendix A. 4. | 

To produce an inference procedure that is invariant under some X-Y embedding /, 
we must ensure that for every KB, Ix(KB) and Iy(KB) correspond. At first glance, it 
seems rather difficult to guarantee correspondence for every knowledge base. It turns out 
that the situation is not that bad. In the remainder of this section, we show how, starting 
with a correspondence for the knowledge base true — that is, starting with a correspondence 
between ix(Ax) and Jy(Ay) — we can bootstrap to a correspondence for all KB's, using 
standard probabilistic updating procedures. 

First consider the problem of updating with objective information. The standard way 
of doing this update is via conditioning. For a measure fi £ Ax and an event SCI, define 
fi\S to be the measure that assigns probability fi(w)/n(S) to every w € S, and zero to all 
other states. For a set of measures T>x ^ Ax, define T>x\S to be {fi\S : fi £ £">x}- The 
following result is easy to show. 

Proposition 6.4: Let S C X be an event and let f be a faithful X-Y embedding. If fi and 
v correspond under f , then fi\S and v\f(S) also correspond under f . 

Proof: Almost immediate from the definitions; left to the reader. (In any case, note that 
this result follows from Theorem 6.4 below.) I 

Clearly, the result extends to sets of measures. 

Corollary 6.5: If f is a faithful X-Y embedding, and T>x and T>y correspond under f , 
then T>x\S and T>y\f(S) also correspond under f . 

What if we want to update on a constraint that is not objective? The standard extension 
of conditioning to this case is via relative entropy or KL-divergence (Kullback & Leibler, 
1951). 

9. While (a) implies (b) for arbitrary spaces, the implication from (b) to (a) depends on the restriction to 
finite spaces made in this section. For suppose that X is the natural numbers N, f is the identity, T>x 
consists of all probability measures on N, and T>y consists of all measures but that measure fio such 
that Ho{n) = l/2 n+1 . If the language consists of finite Boolean combinations of assertions of the form 
Pr('S') > a ) f° r S C N, then it is easy to see that T>x \= iff XV |= for all formulas 6, but clearly T>x 
and T>y do not correspond under the identity map. 
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Definition 6.6: If fi and fi' are measures on X, the relative entropy between fi! and fi, 
denoted KLx(fi'Wfi), is defined as Y^xex ^'( x ) l°g(^ / ( x )/^( x ))- For a measure /ionI and 
a constraint 9, let denote the set of measures fi' satisfying 9 for which KLx(fi'\\fi) is 
minimal. | 

Intuitively, the KL-divergence measures the "distance" from fx' to fi. A measure fi' sat- 
isfying 9 for which KLx(fi'Wfi) is minimal can be thought of as the "closest" measure to 
\i that satisfies 9. If 9 denotes an objective constraint, then the unique measure satisfy- 
ing 9 for which KLx(fi'Wfi) is minimal is the conditional measure fi\9 (Kullback & Leibler, 
1951). (That is why we have deliberately used the same notation here as for conditioning.) 
Moreover, it is easy to show that KLx(fi'Wfi) = iff fi' = fi. It follows that if /i € 0, then 

n\e = n. 

Given a set of measure T>x f= and a constraint 9 on Ax , define T>x \ 9 to be U^x> x A* I ^ • 
We can now apply a well-known result (see, e.g., (Seidenfeld, 1987)) to generalize Propo- 
sition 6.4 to the case of relative entropy. 

Theorem 6.7: Let 9 be an arbitrary constraint on Ax- If f is a faithful X-Y embedding 
and fi and v correspond under f , then fi\9 and u\f*{6) also correspond under f . 

Proof: See Appendix A. 4. | 

Again, this result clearly extends to sets of measures. 

Corollary 6.8: If f is a faithful X-Y embedding, and T>x and T>y correspond under f, 
then T>x\9 and T>y\f*(9) also correspond under f . 

These results give us a way to "bootstrap" invariance. We construct an inference pro- 
cedure that uses relative entropy starting from some set of prior probability measures. In- 
tuitively, these encode the user's prior beliefs about the domain. As information comes in, 
these measures are updated using cross-entropy. If we design the priors so that certain in- 
variances hold, Corollary 6.8 guarantees that these invariances continue to hold throughout 
the process. 

Formally, a prior function V on X maps X € X to a set V(X) of probability measures 
in Ax- Define an inference procedure by taking I^(KB) = V(X)\KB. Note that 
Ix(true) = V(X), so that when we have no constraints at all, we use V(X) as the basis 
for our inference. Most of the standard inference procedures are of the form I v for some 
prior function V . It is fairly straightforward to verify, for example, that entailment is 1^ 
for V(X) = Ax- (This is because, as observed earlier, fi\KB = fi if \x € KB.) Standard 
Bayesian conditioning (defined for objective knowledge bases) is of this form, where we take 
V(X) to be a single measure for each space X. More interestingly, it is well known (Kullback 
& Leibler, 1951) that maximum entropy is I Vu where V U (X) is the singleton set containing 
only the uniform prior on X. 

So what can we say about the robustness of I v to representation shifts? Using Propo- 
sition 6.3 and Corollary 6.5, it is easy to show that if we want Z v to be invariant under 
some set T of embeddings, then we must ensure that the prior function has the right 
correspondence property. 

Theorem 6.9: If f is a faithful X-Y embedding, then I v is invariant under f iff V{X) 
and V(Y) correspond under f . 
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Proof: See Appendix A. 4. | 

Theorem 6.9 sheds some light on the maximum entropy inference procedure. As we 
mentioned, \^ me is precisely the inference procedure based on the prior function V u - The 
corollary asserts that |~ TOe is invariant under / precisely when the uniform priors on X 
and Y correspond under /. This shows that maximum entropy's lack of representation 
independence is an immediate consequence of the identical problem for the uniform prior. 
Is there a class T of embeddings under which maximum entropy is invariant? Clearly, the 
answer is yes. It is easy to see that any embedding that takes the elements of X to (disjoint) 
sets of equal cardinality has the correspondence property required by Theorem 6.9. It follows 
that maximum entropy is invariant under all such embeddings. In fact, the requirement that 
maximum entropy be invariant under a subset of these embeddings is one of the axioms in 
Shore and Johnson's (1980) axiomatic characterization of maximum-entropy. (We remark 
that Paris (1994, Theorem 7.10) proves that maximum entropy satisfies a variant of his 
atomicity principle; his invariance result is essentially a special case of Theorem 6.9.) 

If we do not like the behavior of maximum entropy under representation shifts, The- 
orem 6.9 provides a solution: we should simply start out with a different prior function. 
If we want to maintain invariance under all representation shifts, V{X) must include all 
non-extreme priors (i.e., all the measures \x on X such that fJ.(A) ^ {0, 1} for all A such 
that A £ {0, X}). This set of priors gives essential entailment as an inference procedure. If, 
however, we have prior knowledge as to which embeddings encode "reasonable" represen- 
tation shifts, we can often make do with a smaller class of priors, resulting in an inference 
procedure that is more prone to leap to conclusions. Given a class of "reasonable" embed- 
dings J 7 , we can often find a prior function V that is "closed" under each / G J 7 , i.e., for 
each measure jj, G V(X) and each X-Y embedding / G F we make sure that there is a 
corresponding measure v G V(Y), and vice versa. Thus, we can guarantee that V has the 
appropriate structure using a process of closing off under each / in T . 

Of course, we can also execute this process in reverse. Suppose that we want to support 
a certain reasoning pattern that requires leaping to conclusions. The classical example of 
such a reasoning pattern is, of course, a default assumption of independence. What is the 
"most" representation independence that we can get without losing this reasoning pattern? 
As we now show, Theorem 6.9 gives us the answer. 

We begin by providing one plausible formulation of the desired reasoning pattern. For 
a finite space X, we say that X± x • • • x X n is the product decomposition of X if X = 
X± x • • • x X n and n is the largest number for which X can be written as a product in this way. 
(It is easy to see that if X is finite, then this "maximal" product decomposition is unique.) 
A measure fi G Ax is a product measure on X if X\ x • • • x X n is the product decomposition 
of X and there exist measures G Ax^ for i = 1, . . . , n such that fx = fj,i x ■ ■ ■ x fi n , that 
is, n(Ui x • • • x U n ) = Iir=i fH{Ui), if Ui C X{, i = 1, . . . , n. Let Vn be the set of all product 
measures on X. If Vu is the prior and the relative entropy rule is used to update the prior 
given a knowledge base, then [^p n satisfies a form of minimal default independence. In 
fact, it is easy to show that it satisfies the following stronger property. 
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Proposition 6.10: Suppose that X\ x • • • x X n is the product decomposition on X and, for 
each i = 1, . . . ,n, KBi is a constraint on Xi, and Si is a subset of X{. Then 

n n 

f\ KBi h/ Pn Pr(5i A . . . A S n ) = ]J Pr(5i). 
i=i n i=i 

Proof: See Appendix A. 4. | 

Theorem 4.16 shows that \^-p n cannot be invariant under all embeddings. Theorem 6.9 
tells us that it is invariant under precisely those embeddings for which Vn is invariant. These 
embeddings can be characterized syntactically in a natural way. Suppose that <3?i, . . . , is 
a partition of a finite set <& of primitive propositions. Note that a truth assignment to the 
primitive propositions in can be viewed as a "crossproduct" of truth assignments to the 
primitive propositions in $i, . . . , $ n . Under this identification, suppose that a set X of truth 
assignments to $ is decomposed as X\ x • • • x X n , where Xi consists of truth assignments 
to $j. In that case, if p G and q,r € <&k for some j ^ k, then true f-^pPr(p A q) = 
Pr(p) x Pr(g), but since since q and r are in the same subset, we do not have true Pr(r A 
q) = Pr(r) x Pr(g). Hence, Vn is not invariant under an interpretation i that maps p to 
r and maps q to itself. Intuitively, the problem is that i is "crossing subset boundaries"; 
it is mapping primitive propositions that are in different subsets to the same subset. If we 
restrict to interpretations that "preserve subset boundaries", then we avoid this problem. 

We can get a semantic characterization of this as follows. If the product decomposition 
of X is X\ x • • • x X n and the product decomposition of Y is Y± x • • • x Y n , then / is 
an X-Y product embedding if / is an X-Y embedding and there are Xi-Yi embeddings /j, 
i = l,...,n, and f((x±, . . . , x n )) = fi(x±) x ••• x f n (x n ). Product embeddings capture 
the intuition of preserving subset boundaries; elements in a given subset Xi remain in 
the same subset (Yi) after the embedding. However, the notion of product embedding is 
somewhat restrictive; it requires that elements in the ith subset of X map to elements in 
the ith. component of Y, for i = 1, . . . , n. We can still preserve default independence if the 
components of a product are permuted. An g is a permutation embedding if there exists a 
permutation it of {1, . . . , n} such that g({x±, . . . , x n )) = (x n ^, . . . , x n ^). 

Theorem 6.11: The inference procedure Ip n is invariant under faithful product embeddings 
and under permutation embeddings. 

Theorem 6.9 thus provides us with the basic tools to easily define an inference procedure 
that enforces minimal default independence for constraints involving disjoint parts of the 
language, while at the same time guaranteeing invariance under a large and natural class 
of embeddings. Given our negative result in Theorem 4.16, this type of result is the best 
that we could possibly hope for. In general, Theorem 6.9 provides us with a principled 
framework for controlling the tradeoff between the strength of the conclusions that can be 
reached by an inference procedure and invariance under representation shifts. 

7. Related Work 

As we mentioned earlier, there are two types of probabilistic inference. We partition our 
discussion of related work along those lines. 
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7.1 Probabilistic Inference from a Knowledge Base 

Given the importance of representation in reasoning, and the fact that one of the main crit- 
icisms of maximum entropy has been its sensitivity to representation shifts, it is surprising 
how little work there has been on the problem of representation dependence. Indeed, to the 
best of our knowledge, the only work that has focused on representation independence in 
the logical sense that we have considered here prior to ours is that of Salmon and Paris. 

Salmon (1961) defined a criterion of linguistic invariance, which seems essentially equiv- 
alent to our notion of representation independence. He tried to use this criterion to defend 
one particular method of inductive inference but, as pointed out by Barker in the commen- 
tary at the end of (Salmon, 1961), his preferred method does not satisfy his criterion either. 
Salmon (1963) then attempted to define a modified inductive inference method that would 
satisfy his criterion but it is not clear that this attempt succeeded. In any case, our results 
show that his modified method certainly cannot be representation independent in our sense. 

As we said earlier, Paris (1994) considers inference processes, which given a constraint on 
Ax, choose a unique measure satisfying the constraint. He then considers various properties 
that an inference process might have. Several of these are closely related to properties that 
we have considered here. (In describing these notions, we have made some inessential 
changes so as to be able to express them in our notation.) 

• An ^-inference process I is language invariant if all X, Y G X and all constraints KB 
and ip on Ax, we have that KB \^i x i P iff KB \^i XxY <P- Clearly language invariance 
is a special case of robustness. Paris shows that a center of mass inference process 
(that, given a set A C Ax, chooses the measure that is the center of mass of A) is 
not language invariant; on the other hand, it is well known that maximum entropy is 
language invariant. 

• An A'-inference process / satisfies the principle of irrelevant information if for all 
spaces X, Y G X, constraints KB and ip on Ax, and constraints if; on Ay, we have 
KB \^j x l f iff KB A ijj Y J i x Y f- Again, this is a special case of robustness, since a 
constraint ip on Ay must be X-conservative. Paris shows that maximum entropy 
satisfies this principle. (He restricts the domain of the maximum entropy process to 
closed convex sets, so that there is always a unique probability measure that maximizes 
entropy.) 

• An ^-inference process / satisfies the renaming principle if, whenever X and Y are 
finite spaces, g : X — > Y is an isomorphism, and / : 2 X — > 2 Y is the faithful embedding 
based on g (in that f(S) = {g(s) : s G S}), then for all constraints KB and 6 on Ax, 
we have KB {^j x iff f*(KB) \^ Iy f*(0). Clearly, the renaming principle is a special 
case of representation independence. Paris shows that a number of inference processes 
(including maximum entropy) satisfy the renaming principle. 

• An A'-inference process / satisfies the principle of independence if, whenever X, Y, 
and Z are in X, S G Tx, T G Ty, U G Tz, and KB is the constraint Pr({7) = 
a A Pt(S\U) = b A Pi(T\U) = c, where a > 0, then KB f- Pr(S x T\U) = be. Ig- 
noring the conditional probabilities, this is clearly a special case of minimal default 
independence. Paris and Vencovska (1990) show that maximum entropy is the unique 
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inference process satisfying a number of principles, including renaming, irrelevant 
information, and independence. 

• An X -inference process / satisfies the atomicity principle if, for all X, Yi, . . . , Y n in 
X , whenever /' is an embedding from {0, 1} to X, and / is the obvious extension of 
/' to an embedding from to {0, 1} x Y\ x . . . x Y n to X x Y\ x . . . x Y n , then for all 
constraints KB and 6 on A{ 0jl } x y lX . .. x y„, we have KB \" I iff f*(KB) f*{9). 
Clearly atomicity is a special case of representation independence. Paris shows that 
there is no inference process that satisfies atomicity. The argument is similar in spirit 
to that used to prove Theorems 4.11 and 4.16, but much simpler, since inference 
processes return a unique probability measure, not a set of them. 

More recently, Jaeger (1996), building on our definitions, has examined representation 
independence for general nonmonotonic logics. He considers representation independence 
with respect to a collection of transformations, and proves results about the degree to 
which certain nonmonotonic formalisms, such as rational closure (Lehmann & Magidor, 
1992), satisfy representation independence. 

Another line of research that is relevant to representation independence is the work 
on abstraction (Giunchiglia & Walsh, 1992; Nayak & Levy, 1995). Although the goal of 
this work is again to make connections between two different ways of representing the same 
situation, there are significant differences in focus. In the work on abstraction, the two ways 
of representing the situation are not expected to be equivalent. Rather, one representation 
typically abstracts away irrelevant details that are present in the other. On the other hand, 
their treatment of the issues is in terms of deductive entailment, not in terms of general 
inference procedures. It would be interesting to combine these two lines of work. 

7.2 Bayesian Probabilistic Inference 

Bayesian statistics takes a very different perspective on the issues we discuss in this paper. 
As we discussed, the Bayesian approach generally assumes that we construct a prior, and use 
standard probabilistic conditioning to update that prior as new information is obtained. In 
this approach, the representation of the knowledge obtained has no effect on the conclusions. 
Two pieces of information that are semantically equivalent (denote the same event) will have 
precisely the same effect when used to condition a distribution. 

In this paradigm, our analysis is more directly related to the step that precedes the 
probabilistic conditioning — the selection of the prior. When we have very specific beliefs 
that we want to encode in a prior distribution (as we do, for example, when constructing 
a Bayesian network), we design our prior to reflect these beliefs in terms of the vocabulary 
used. For example, if we have a particular distribution in mind over the location of an object, 
we will encode it one way when representing the space in terms of Cartesian coordinates, 
and in another way when using polar coordinates. In effect, we can view the representation 
transformation as an embedding /, and the two priors as corresponding under /, in the 
sense of Definition 4.2. Thus, the design of the prior already takes the representation into 
account. 

On the other hand, when we are trying to construct an "uninformed" prior for some class 
of problems, the issue of representation independence becomes directly relevant. Indeed, 
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most of the standard problems with maximum entropy arise even in the simple case when 
we simply do Bayesian conditioning starting with a uniform prior over our space. 

A standard approach in Bayesian statistics is to use the invariance under certain trans- 
formations in order to define an appropriate uninformed prior. For example, we might 
want a prior over images that is invariant to rotation and translation. In certain cases, 
once we specify the transformation under which we want a measure to be invariant, the 
measure is uniquely determined (Jaynes, 1968; Kass & Wasserman, 1993). In this case, the 
argument goes, the uniquely determined measure is perforce the "right" one. This idea of 
picking a prior using its invariance properties is in the same spirit as the approach we take 
in Section 6. Indeed, as this approach simply uses standard probabilistic conditioning for 
objective information (such as observations), the Bayesian approach with an uninformed 
prior invariant to a set of embeddings is, in a sense, a special case. However, our approach 
does not force us to choose a unique prior. Rather, we allow the use of a set of prior 
distributions, allowing us to explore a wider spectrum of inference procedures. 

This approach is also related to the work of Walley (1996), who observes that representa- 
tion independence is an important desideratum in certain statistical applications involving 
multinomial data. Walley proposes the use of sets of Dirichlet densities to encode ignorance 
about a prior, and shows that this approach is representation independent in its domain of 
application. 

8. Conclusions 

This paper takes a first step towards understanding the issue of representation depen- 
dence in probabilistic reasoning, by defining notions of invariance and representation inde- 
pendence, showing that representation independence is incompatible with drawing many 
standard default conclusions, and defining limited notions of invariance that might that 
allow a compromise between the desiderata of being able to draw interesting conclusions 
(not already entailed by the evidence) and representation independence. Our focus here 
has been on inference in probabilistic logic, but the notion of representation independence 
is just as important in many other contexts. Our definitions can clearly be extended to 
non-probabilistic logics. As we mentioned, Jaeger (1996) has obtained some results on rep- 
resentation independence in a more general setting, but there is clearly much more that can 
be done. More generally, it would be of interest to understand better the tension between 
representation independence and the strength of conclusions that can be drawn from an 
inference procedure. 
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Appendix A. Proofs 
A.l Proofs for Section 2 

Proposition 2.5: Let |~ be a relation on probabilistic constraints on X for which the 
properties Reflexivity, Left Logical Equivalence, Right Weakening, Infinitary And, and Con- 
sistency hold for all KB in the domain of |~ . (That is, if KB is in the domain of |~ , in 
that KB |~ 9 for some 9, then KB |~ KB, and so on.) Then |~ is |~ 7 for some X-inference 
procedure I. 

Proof: Define / as follows. If A C Ax, KB is in the domain of |~ , and A = {KBjx 
for some statement KB, then A is in the domain of / and 1(A) = n{[#]x : KB \^9}. 
Note that by Left Logical Equivalence, this is well defined, since if A = {KB'Jx, then 
n{{ej x ■■ KB Ml = n{[6»] x : KB' f~0}. If A + \KB\ X for some statement KB, then A is 
not in the domain of I. It remains to check that I is an X-inference procedure (i.e., that 
1(A) C A and that 1(A) = iff A = for all A in the domain of I), and that f- = f~ 7 . 
To check that I is an X-inference procedure, suppose that A is in the domain of /. Thus, 
A = [KB\ X By Reflexivity, it easily follows that I(\KB\ X ) Q \KB\ X - Next suppose that 
I(\KB\ X ) = 0. It follows that n{[0] x ■ KB ^9} = 0. Thus, {6 : KB ^9} \= false. By 
the Infinitary AND rule, we must have KB |~ 7 false. By the Consistency Rule, it follows 
that [XB]x = 0. Thus, I is indeed an X-inference procedure. Finally, note that if KB 
then, by definition of /, 7([XB]x) Q hP\x, so KB \^jip. For the opposite inclusion, note 
that if KB -0, then {9 : KB f~ 9} \= ^. Thus, by the Infinitary And rule, it follows that 
KB I 

A. 2 Proofs for Section 3 

To prove Theorem 3.4, we need the following lemma. 

Lemma A.l: Given two spaces Xq and X\, measures fi° G A(x ,f x ) an d /U 1 G A^x 1 ,J r Xl )' 
and subsets Sq G !Fx o- n d Si G Tx x such that n (So) = ^(Si), there exists a measure 
^ G A (x xX 1 ,^ X()XXl ) such that n 2 x . = n\ for i = 1, 2, and fi 2 (S & Si) = l. 10 

Proof: For A x B G Tx Q x Fx x , define 

/x 2 (A xB) = (n°(A n So)^(b n s^/^HSi)) + (fjP(AnsZ)iJ, 1 (Br\S^)/n 1 (si) ) , 

where we take fi°(A n S )n 1 (B n SiV^-Si) = if ^(S^ = and take fi° (A nSll) fi 1 (B n 
ST)/^ 1 ^) = if ^(Si) = 0. Extend to disjoint unions of such sets by additivity. Since 

10. If A and B are sets, we use the notation A <^4> B to denote the set (A fl S) U (A n S). 



2G 



Representation Dependence 



all sets in Fx xXi can be written as disjoint unions of sets of the form AxBG Tx$ x Fx\, 
this suffices to define fi 2 . To see that fi 2 is actually a measure, note that fj?(X x Y) = 
/jP(So) + /jP(Sq) = 1. Additivity is clearly enforced by the definition. Finally, to see that 
/i 2 has the desired properties, suppose that /J, 1 (Si) / and /^(Si) / 0. (The argument is 
easier if this is not the case; we leave details to the reader.) Then 

fj? Xo (A) = v 2 (A xY)= vf>(A n S )fi 1 (S 1 )/ t i 1 (S 1 ) + » (A n ^(sD/m 1 ^ 

= //>(A n So) + n s ) = 

Since fjP(So) = /U 1 (Si) by assumption (and so /jP(Sq) = / u 1 (Si)), 

= ii 2 {X xB) = fi°{SoW(B n Si)//* 1 ^ + fx°(S^)^(B n sTV/^sT) 
= ti\Bn Si) + /(sn so = ^(B). 

This completes the proof. | 

Theorem 3.4: 7/ {Jx : G ^ } is a robust X -inference procedure that satisfies DI1, DI2, 
and DI3, then Ix is essentially entailment for all X G X . 

Proof: Suppose that {Ix '■ X G X} is robust and Ix is not essentially entailment for X G X. 
Then there must be a constraint iTi? on Ax and a set S G Tx such that KB |~ 7 a < Pr(S) < 
/3 and KB ^ a < Pr(S) < /3. Thus, there must be some 7 £ [a, 0\ such that KB APr(S) = 7 
is consistent. We can assume without loss of generality that 7 < a (otherwise we can replace 
SbyS). 

We first construct a space Yq G X that has subsets U±, . . . , U n with the following prop- 
erties: 

(a) There is no measure /x G Ay such that /x(£/j) > a, for all i = 1, ...,n. 

(b) For each i, there is some measure ^ G Ay such that Hi(U) = 1 and ^(Uj) > 7 for 
all j / i. 

We proceed as follows. Choose n and d such that 7 < (d — l)/(n — 1) < d/n < a. By 
assumption, there exists a Yq G X such that \Yq\ = n\/(n — d)\. Without loss of generality, 
we can assume that Yq consists of all tuples of the form (a±, . . . , ad), where the a^s are all 
distinct, and between 1 and n. Let U be consist of all the tuples in Yo that have i somewhere 
in the subscript; it is easy to see that there are d(n — l)!/(n — d)\ such tuples. Suppose that 

H is a probability measure in Ay . It is easy to see that n(Ui) H h n(U n ) = d, since each 

tuple in Yo is in exactly d of the U^s and so gets counted exactly d times, and the sum of the 
probabilities of the tuples is 1. Thus, we cannot have fJ>(Ui) > d/n for all i (and, a fortiori, 
we cannot have fJ,(U) > a for all i). This takes care of the first requirement. Next, consider 
a probability distribution ^ that makes all the tuples making up Ui equally probable, and 
gives all the other tuples probability 0. Then it is easy to see that ^(Ui) = 1. Moreover, 
since it is straightforward to check that there are exactly d(d — l)(n — 2)!/(n — d)\ tuples 
in Ui n Uj for j + i, we have n[(Uj) = [d{d - l)(n - 2)!/(n - d)\]/[d{n - l)!/(n - d)\] = 
(d — l)/(n — 1). This takes care of the second requirement. 

By assumption, there is also a measurable space Y G X such that \Y\ = 2. Suppose 
that Y = {y,y'}- Let Z = X n x Yq x Y n , where the n is the same as the n chosen in the 
construction of Yq. Again, by assumption, Z G X. For i = 1, . . . , n, 
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• iiACX, let Ai = X 1 ' 1 x A x X n -'' 1 xY xY n CZ. 

• let KB,, = {fieA z : n Xi G KB}; 

• let 3^ be the subset of Y n where the ith copy of Y is replaced by {y}; 

• let Vi be the subset of Z of the form X n xUixYi (where U±, . . . , U n are the subsets 
of Yi constructed above) . 

Let a be the following constraint on A^: 

KB X A ... A KB n A Pr(Si 4$ V\) = 1 A ... A Pr(S„ ^ V n ) = 1. 

Let Xj denote the ith copy of X in Z. That is, for ease of exposition, we view Z as 
being of the form X± x • • • x X„ x Yq x Y m , although all the Xj's are identical, since it is 
helpful to be able to refer to a specific X{. We claim that a is ^-conservative over KB, 
for i = 1, . . . ,n. Thus, we must show that proj x .{\KBi A cr}z) = IKBJx- It is immediate 
that proj Xi (\KBi A o\z) Q \KBjx- For the opposite inclusion, suppose that v G \KB}x- 
We must show that there exists some fi G \KBi A a]z such that nx { = We proceed as 
follows. 

Let n' be a measure in Ay such that /j,' Q (Ui) = 1 and n' Q (Uj) > 7, for j 7^ i. By 
construction of the Uj's, such a measure must exist. For j G {1, . . . , n}, let be the measure 
in Ay such that Av) = u(S) and if j ^ i, then /^(y) = j/n' (Uj) (and /^(y') = 1 - fj/j(y)). 
Let // be the measure on Yq x Y n that is the "crossproduct" of n' , . . . , n' n . That is, 
//'(T x ••• x T n ) = jU (T ) x ••• x fi' n (T n ). By construction, /x'(l^) = 7 for j / z and 

AW = HS). 

By assumption, there is a measure i/q G Ax such that z/q |= XB A Pr(S') = 7. We 
now proceed inductively to define a measure /j fc G A X fc x y oxy „ such that (a) Pr((5i <^ 
Vi) n . . . n (Sk H)) = 1, (b) /x y = // and /r^. = v for j = 1, . . . , k. We define /jP = jJ . 
For the inductive step, we simply apply Lemma A.l. Finally, we take [i to be /x n . Our 
construction guarantees that fx X j = v, hence that fi \= KBj. In addition, the construction 
guarantees that \i |= Pr(5i V\) = 1 A ... A Pr(S" n <3> V n ) = 1. Hence /j |= <t, as desired. 

It follows from DI1, DI2, and DI3 that a is in the domain of Iz- Since KBi A a is 
equivalent to a, it follows that KBi Act is also in the domain of Iz- Now, by robustness, for 
any constraint ip on Ax,, we have KBil\o |~ 7 </? iff KBi |~j V- Since lT5j |~ 7 Pr(S'j) > a and 
KBi A <t is equivalent to <r, it follows that cr Pr(Si) > a for i = 1, . . . , n. By the And rule 
(Proposition 2.3), it follows that a ^ Pr(Si) > a A ... A Pr(5 n ) > a. Since a |= Pr((5i 4^ 
Vi) n (S n 4$ V n )) = 1, it easily follows that a Pr([/i) > a A ... A Pr(f7 n ) > a. But our 
construction guarantees that Pr(£/i) > aA. . .APr(£/ n ) > a is inconsistent. Thus, a Y~> T false. 
By robustness, it follows that KBj false. But this can happen only if ifB |= false, which 
implies that KB \= a < Pr(S) < (3, contradicting our original assumption. | 

A. 3 Proofs for Section 4 

To prove Lemma 4.6, it is useful to first prove two additional results: 
Lemma A. 2: If f is an X-Y embedding, then f(X) = Y and /(0) = 0. 
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Proof: Suppose that / is an X-Y embedding. We first show that /(0) = 0. From the 
definition of embedding, it follows that /(0) = /(Xn0) = /(X)n/( 0). Th us, /(0) C /(X). 
But the definition of embedding also implies that /(0) = f(X) = f(X). Thus, we have 
J[X) C f(X). This can happen only if f{X) = Y and /(0) = f{X) = 0. I 

Lemma A. 3: If f is a faithful X-Y embedding, then 

(a) for any fi G Ax, i/iere is a measure u G Ay smc/i f/i-ai ^ corresponds to (j,; 

(b) for any v G Ay, i/iere is a measure fi G Ax such that /i corresponds to v. 

Proof: To prove (a), consider the algebra of subsets of Y the form f(S), for S G .Tx- 
Define a function z/ on the algebra via v'(f{S)) = /J,(S). This mapping is well defined, 
for if f(S) = f(T), then faithfulness guarantees that S = T. Moreover, v' is a probability 
measure on the algebra. To see this, note by Lemma A. 2 that v'(Y) = v'{f(X)) = n(X) = 1. 
Moreover, if f(S) H f(T) = 0, then (by definition of embedding) f(S D T) = and so, since 
/ is faithful, 5 n T = (for otherwise f(S (IT) = /(0) by Lemma A.2, but S n T + 0). 
Thus, 

v'{f{S) U f{T)) = v'{f{S U T)) = M (5 U T) = ^(5) + /.(T) = + u'{f{T)). 

As shown by Horn and Tarski (1948), it is possible to extend v' to a probability measure v 
on ^y. 11 By construction, we have that v corresponds to 

To prove (b), we use a very similar process. Define a function /i on the algebra of sets 
SCI via /j,(S) = u(f(S)). It is easy to see that [i is already a probability measure in Ax, 
which by construction corresponds to v. | 

We can now prove Lemma 4.6. 
Lemma 4.6: An X-Y embedding f is faithful if and only if for all constraints KB and 6, 
we have KB \= 6 iff f* {KB) \= f*{9). 

Proof: Suppose that / is faithful. To show that KB \= 9 iff f*(KB) \= f*(0), we must 
show that \KB\x C \0\ x iff \f*(KB)\ Y C [f*(0] Y . The "only if" direction is immediate 
from the definition of /*. To prove the "if" direction, suppose not. Then there must exist 
some j! G [iTSjx — \0\x such that /*(//) C [/*(^)]y. Let v be some probability measure 
that corresponds to fj,. Since v G /*(/u) C f*(0), there must be some fj,' G [6*]x such that 
v G f*(n'). Since fi' ^ fi, there must be some S G ^x such that n'(S) ^ n(S). Since 
v G f*(fi) n f*(n'), we must have both v(f(S)) = fJ-(S) and u(f(S)) = /J-'(S). But this is a 
contradiction. This completes the proof of the "if" direction. 

For the converse, suppose we have KB \= 9 iff f*(KB) (= /*(#) for all KB and 0. Given 
S 1 , T G J^x, we have the following chain of equivalences: 

11. It is critical for this result that we are working with finitely additive measures. There may not be a 
countably additive measure v extending z/, even if v' is countably additive. For example, take T' Y to be 
the Borel sets on [0, 1] and take Ty to be all subsets of [0, 1]. Let v' be Lebesgue measure. It is known 
that, under the continuum hypothesis, there is no countably additive measure extending v' defined on 
all subsets of [0, 1] (Ulam, 1930) (see (Keisler & Tarski, 1964) for further discussion). 
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SQT 

iff Pr(S) = 1 |= Pr(T) = 1 

iff /*(Pr(5) = 1) |= /*(Pr(T) = 1) (by assumption) 
iff Pr(/(S)) = 1 |= Pr(/(T)) = 1 (by definition of /*) 
iff f(S)Cf(T). 
Thus, / is faithful. I 

Proposition 4.7: Let f be a faithful X-Y embedding. Then the following statements are 
equivalent: 

(a) n and v correspond under f ; 

(b) for all formulas 9, n \= 9 iff v |= f*(9). 

Proof: We first show that (a) implies (b). So suppose that \x and v correspond under /. 
The only if direction of (b) is trivial: If [i \= 9 then v G /*(//) Q /*(#)> since / is faithful. 
For the if direction, we proceed much as in the proof of Lemma 4.6. Assume that v \= f*(9) 
but that n y= 9. Since v G f*(9), by definition of /* there must be some jj! G \9\x such that 
v G /*(//). Since fjf \= 9 whereas \i Y= 9, we must have fi ^ fi'. Hence, there must be some 
S G Tx such that n(S) + n'(S). Since v G f*{p) n /*(/*'), it follows that u(f(S)) = fi{S) 
and that v(f(S)) = fJ-'(S), which gives the desired contradiction. 

We now show that (b) implies (a). Assume by contradiction that /x and v do not 
correspond under /. Then there must be some event S G Tx such that n(S) / u(f(S)). 
Let p = n(S) and let 9 be the constraint Pr(5) = p. Then \i \= 9, whereas v tf= f*(9), 
providing the desired contradiction. | 

Theorem 4.10: If an X -inference procedure is robust that satisfies DI2, DI4, and DI5, 
then it is representation independent. 

Proof: Suppose that {Ix ■ X G X} is a robust ^-inference procedure. We want to show 
that it is representation independent. So suppose KB, ip are constraints on Ax and / is an 
X-Y embedding, for some X,Y eX. We want to show that KB ^ Ix <p iSf*(KB) f~ /y /*(¥>). 
Let ip be the following constraint on AxxY- 

(<p&f*(<p))A(KB&r(KB)). 

We claim that ip is A-conservative over KB and Y-conservative over f*{KB). Thus, we must 
show that proj x {\KB A^jxxv) = \KB\ X and proj Y {\f*(KB) A tpJxxY) = {f*{KB)\ Y . 
We show that proj X {\KB A iPJxxy) = [-A^lx here; the argument that proj Y (lf*(KB) A 
i>\xxY) = lf*(KB)}y is almost identical. 

Clearly if fi G [KB A 0] Xx y then fi x G [KB] X , so pro] X {\KB A Vkxr) C [KB] x . 
For the opposite inclusion, suppose that v G [A5]x- We want to find a measure v' G 
{KB A i/jJxxy) such that v' x = v. Let v" be any measure in /*(//) and let 1/' G AxxY 
be the "crossproduct" of v and 1/"; that is, v\A x B) = v{A)v"{B). Clearly v' x = v. To 
see that v' G {KB A ■iPJ Xx y), it clearly suffices to show that u' \= ip. But since v and v" 
correspond under /, it is immediate from Proposition 4.7 that v \= KB iff v" |= f*{KB) 
and v |= <p iff 1/" |= f*(<p). Thus, ^ |= -0, as desired. 
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Now suppose that KB {^i x <f- By DI2 and DI5, KB A ip is in the domain of IxxY- By 
robustness, KB A vj ^/ Xxy <P- Thus, /([IfB A Vkxr) C H Xx y. Since I{\KB A flx x y) C 
A Vkxy C ^ /*((^)kxy, it follows that A iP] XxY ) C [/»]x x y- 

Moreover, KB A ip is equivalent to A V, so I({f*(KB) A </>]x x y) C [f((p)]x x y, 

i.e., /*(#B) A ^ h/ Xxy /*(^)- By DI4, /*(#B) is in the domain of I Y . Since ^ is F- 
conservative over f*(KB), the robustness of {Ix ■ X £ X} implies that f*(KB) /*(¥>)• 
The opposite implication (if f*(KB) \^ Iy /*(</>) then <p) goes the same way. Thus, 

{Ix '■ X £ X} is representation independent. | 

Next, we turn our attention to Theorems 4.11 and 4.16. Both of these results follow in 
a relatively straightforward way from one key proposition. Before we state it, we need some 
definitions. 

Definition A. 4: We say that a constraint KB on Ax depends only on Si, . . . , S& £ Tx 
(the sets Si, . . . , S^ are not necessarily disjoint) if, whenever fi, jj,' £ Ax agree onSi,..., Sk, 
then ft (= KB iff y! \= KB. I 

For example, if KB has the form Pr(Si) > 1/3 A Pr(S < 2) < 3/4, then iTi? depends only 
on Si and S2. Similarly, if KB has the form Pr(Si | S2) > 3/4, then KB depends only on 
Si and S*2. 

Definition A. 5: Given Si, . . . , Sk € T x , an atom over Si, . . . , Sk is a set of the form 
Ti fl . . . ("I Tk, where Tj is either Sj or Si. I 

Proposition A. 6: Suppose that {I x : X £ X} is an X -inference procedure and, for some 
X £ X, there exist S, Si, . . . , Sk € Tx and a consistent constraint KB on Ax that depends 
only on Si, . . . , Sk, such that the following two conditions are satisfied: 

• both T n S and T n S are nonempty for every nonempty atom T over Si, . . . , Sk, 

• KB \^j x oi < Pr(S) < (3, where either a > or (3 < 1. 
T/ien {Jx : X £ X} is not representation independent. 

Proof: Suppose, by way of contradiction, that {Ix '■ X £ X} is a representation-independent 
inference procedure but nevertheless, for some X £ X, there exists sets S, Si, . . . , Sk £ J~x 
and a knowledge base KB that satisfies the conditions above, for some a, (3. Assume that 
a > (a similar argument can be used to deal with the case that (3 < 1). 

Let Ti, . . . , Tm be the nonempty atoms over Si, . . . , Sk- Choose N such that l/N < a. 
Our goal is to find a collection /1, . . . , /jv of embeddings of X into some Y £ X such that 
each of these embeddings has the same effect on KB, but such that the sets fj(S) are disjoint. 
Since KB ^ Ix Pr (/,-(£)) > a for j = 1, . . . , N, and ft (KB) = f*(KB) for j = 1, . . . , TV, it 
will follow that f*(KB) Pr (/_,•(£)) > a for j = 1, . . . , AT, a contradiction. We proceed 
as follows. 

By assumption, there exists a set Z in X such that |Z| = MN. Let V = X x Z. 
Since A? is closed under crossproducts, Y £ X. Suppose that Z = {zi, . . . ,zmn}, and let 
%i = { z N(i-i)+ii ■ ■ ■ > z Ni}, for i = 1, . . . , M. Thus, the ZiS partition Z into M disjoint sets, 
each of cardinality N. Let Bi = X x Zj, and let Bij = X x {zjv(i-i)+j}, for j = 1, . . . , N. 
It is easy to see that we can find faithful X-Y embeddings fi, ■ ■ ■ , fn such that 
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1. fj(Ti) = Bi, for i = 1, . . . ,M, j = 1, . . . ,N, 

2. fj (Ti n 5) = Bij, for i = 1, . . . ,M, j = 1, . . . ,N. 

Notice that we need the assumption that both TiC\S and TjflS are nonempty for Ti, . . . , Tm 
(that is, for each nonempty atom over Si, ... , Sk) to guarantee that we can find such faithful 
embeddings. For if T n S = 0, then since fj is an embedding, f{T n S) = / and if 
Ti n S = 0, then /^(Tj D S) = /j(T-) - /(Tj n S)) = 0, which means that B, t = By, again 
inconsistent with the construction. 

It is easy to check that, since KB depends only on Si, ... , Sk, f*(KB) depends only 
on fj(S\),...,fj(Sk), for j = 1,...,N. We next show that fj(Si) is independent of j; 
that is, fj(Si) = fj'(Si) for 1 < j,f < N. Notice that for h = l,...,k, we have that 
fj(Sh) = ^T,QS h fj{Ti) = U{ i:Ti cs h }Bi- Thus, fj(S h ) is independent of j, as desired. Since 
fj(KB) depends only on fj(Si), . . . , fj(Sk), it too must be independent of j. Let KB* be 
fl(KB) (which, as we have just observed, is identical to f%(KB), . . . , f£(KB)). 

Since, by assumption, {Ix ■ X G X} is representation independent, and KB |~j Pr(S) > 
a, we have that KB* Pr(/ j (S)) > a, for j = 1, . . . , N. Thus, KB* Prf/i(S)) > 
a A . . . APr(/jv(S)) > a. But note that, by construction, fj(S) = U^.^ns^jBij- Thus, the 
sets fj(S) are pairwise disjoint. Since a > 1/N, we cannot have iV disjoint sets each with 
probability greater than a. Thus, KB* false. But KB is consistent, so KB* = fj(KB) 
must be as well. Thus, Iy{KB*) ^ 0, by assumption. But this contradicts our conclusion 
that KB* \^ Iy false. Thus, {Ix ■ X G X} cannot be representation independent. I 

We can use Proposition A. 6 to help prove Theorem 4.11. 
Theorem 4.11: If {Ix '■ X £ X} is a representation-independent X-inference procedure 
then, for all X € X, Ix is essentially entailment for all objective knowledge bases in its 
domain. 

Proof: Suppose, by way of contradiction, that {Ix '■ X £ X} is representation independent 
but Ix is not essentially entailment for some X € X and objective knowledge base KB. 
Then there must be some set S € Tx such that KB \^i x a < Pr(S) < (3 and KB \/= a < 
Pr(S) < (3. Without loss of generality, we can assume that KB has the form Pr(T) = 1 for 
some T G Tx- Moreover, we can assume that if T ^ 0, then T has a nonempty, measurable 
strict subset. (For otherwise, choose Y = {y, y'} G X and consider the space X' = X x Y. 
By assumption, X' G X. Let / be the X-Y embedding that maps U G Tx to U x Y. Since 
/ is representation independent, we have that Pr(T x7) = l^,a< Pr(S x Y) < (3, and 
Tx{y}cTxY.) 

If T is nonempty, let Z be any nonempty, measurable strict subset of T (which exists by 
assumption); otherwise let Z be the empty set. Let U be the set (T n S) U (T n Z). Notice 
that SflT = UCiT. Moreover, since, for any set V, Pr(T) = 1 ^> Pr(V) = Pr(VnT) is valid, 
it follows from Reflexivity and Right Weakening that KB Pr(V) = Pr(y n T). Thus, 
KB b-7 x Pr(S) = Pr(SnT) = Pr{UnT) = Pt(U). It follows that KB a < Pi(U) < (3. 

We now want to apply Proposition A. 6. Note that KB depends only on T. Thus, we 
must show that T n U and T n U are nonempty, and if T is nonempty, then T n U and 
T n U are as well. As we observed above, T n U = T n S. Thus, if T n U = 0, then T C S, 
contradicting our assumption that KB Pr(S) > 0. It is easy to see that T PiU = T n S. 
Again, we cannot have T n U = 0, for then T C S, contradicting our assumption that 
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KB hrPr(S') < 1. By construction, T (~)U = T D Z = Z. By assumption, if T / 0, then 
Z ^ 0. Finally, T H f/ = T Pi Z; again, by construction, this is a nonempty set if T ^ 0. It 
now follows from Proposition A. 6 that {Ix '■ X G X} is not representation independent. I 

Corollary 4.12: If {Ix '■ X G ^f} is a representation-independent X-inference procedure, 
then for all X £ X, if KB is an objective knowledge base putting constraints on Ax, and 
KB \^ Ix a < Pr(S') < (3 for some a > and (3 < 1, then a = and (3 = 1. 

Proof: Assume the hypotheses of the corollary hold. Since KB is objective, it is of the 
form Pr(T) = 1 for some T G Tx- Then there are three possibilities. Either (1) T C S, (2) 
T C S, or (3) both T P S and TnS are nonempty. If (1) holds, we have KB \= Pr(S') = 1, 
while if (2) holds, we have KB \= Pr(5) = 0. Thus, both (1) and (2) are incompatible 
with KB \^>j a < Pr(5) < (3. On the other hand, if (3) holds, it is easy to see that for 
all 7, Pr(S') = 7 is consistent with KB (since there is a probability measure that assigns 
probability 7 to T n S and probability 1 — 7 to T Pi S). Since KB \^j x a < Pr(S') < (3, by 
Theorem 4.11, we must have KB \= a < Pr(5) < (3. It follows that the only choices of a 
and (3 for which this can be true are a = and (3 = 1. I 

Theorem 4.16: // {Ix '■ X € X} is an X-inference procedure that enforces minimal 
default independence and satisfies DI1, then Ix is not representation independent. 

Proof: Suppose that {Ix '■ X G X} is an ^-inference procedure that enforces minimal 
default independence and satisfies DI1. Choose X = {x,x'} £ X and let KB be 1/3 < 
Pr(cc) < 2/3. By assumption, X x X G X. We can view KB as a constraint on AxxX', 
in this case, it should be interpreted as 1/3 < Pr({x} x X) < 2/3. by DI1, KB is is the 
domain of IxxX- Note that KB is equivalent to the constraint 1/3 < Pr(a/) < 2/3. By 
minimal default independence, we have that KB Y^i XxX Pr((x,x)) > Pr(x x X)/3 and that 
KB |~/ XxX Pr((x',x')) > Pr(x' x X)/3. Applying straightforward probabilistic reasoning, 
we get that KB {^i XyX P r ({( x > x )i ( x 'i x> )}) > 1/3- We now apply Proposition A. 6, taking 
S to be {(x,x),(x' ,x')} and S' to be {(x, x), (x, x')}. Note that KB depends only on S' . 
It is almost immediate from the definition of S and S' that all of S PI <S", S D S', S PI S', 
and S fl S' are nonempty. Thus, by Proposition A. 6, {Ix '■ X G X} is not representation 
independent. I 

Lemma 4.13: Let X consist of only countable sets. Then {I x : X G X} is a representation- 
independent X-inference procedure. 

Proof: As we said in the main part of the text, it easily follows from Proposition 2.5 that 
I x is an inference procedure for all X G X, since it is easily seen to have the five prop- 
erties described in the proposition. To see that 1° is representation independent, suppose 
that / is a faithful X-Y embedding, for X,Y G X. Clearly KB is objective if and only 
if f*{KB) is objective. If KB is not objective, then it is easy to see that KB Y^^oO iff 
f*(KB) \^j f*(9), since |~ /0 reduces to entailment in this case. So suppose that KB is ob- 
jective and has the form Pr(T) = 1, for some T G T X - Then KB f- /0 iff KBAKB + |= 9. By 
Lemma 4.6, this holds iff f*(KB)f\f*(KB + ) \= f*{9). On the other hand, f*{KB) \^ l0 f*(9) 
iff f*(KB) A {f*{KB)) + |= f*(6) Thus, it suffices to show that f*{KB) A f*{KB+) \= f*{9) 
iff f*(KB) A (f*(KB)) + \= f*{9). It is easy to show that (f*(KB)) + implies f*(KB + ), so 
that if f*(KB) A f*(KB + ) \= f*{9) then f*(KB)A(f*(KB)) + \= f*{9). It is not necessarily 
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the case that f*(KB + ) implies {f*(KB)) + . For example, consider the embedding described 
in Example 4.3. In that case, if KB is the objective knowledge base Pr(colorful) = 1, 
KB + is empty, and hence so is f*(KB + ), while (f*(KB)) + includes constraints such as 
< Pr(green) < 1. Nevertheless, suppose that f*{KB) A (f*{KB)) + \= f*(6) and, by way 
of contradiction, there is some v such that v \= f*(KB) A f*(KB + ) A ->f*(0). Choose n 
such that v G f*{p). Then /j, and v correspond, so \i \= KB A KB + A ->9. It is easy to 
show that there exists u' G f*(/J>) such that < v'{S) < 1 for all nonempty subsets of S of 
f{T). To see this, note that if /j,(x) / 0, then it suffices to ensure that u'(f(x)) = fi(x) and 
v '{y) 7^ f° r an V m f( x )- Since Y is countable, this is straightforward. Since fi and z/ 
correspond, we must have that v' |= ->f*(Q) A f*(KB). By construction, i/' |= (f*(KB)) + . 
This contradicts the assumption that A (f*(KB)) + \= f*(9). I 

Lemma 4.14: Suppose that X consists only of measure spaces of the form (X,2 X ), where 
X is finite. Then {l\ : X e X} is a representation-independent X -inference procedure. 

Proof: Suppose that X, Y G X, KB and ip are constraints on Ax, and / is an X-Y 
embedding. We must show that KB ip iff f*(KB) f*(<p). For the purposes of this 
proof, we say that a subset A of Ax is interesting if there exists some S G Tx such that 
A = {/j, G Ax : > 1/4}. It is easy to see that if KB is interesting then f*(KB) is 

interesting. The converse is also true, given our assumption that X consists of only finite 
spaces where all sets are measurable. For suppose that f*(KB) is interesting. Then there is 
a set T C Y such that f*(KB) = {v G Ay : v(T) > 1/4}. Let i = {S'CI: f(S') D T}. 
Since X is finite, so is ^4; it easily follows that S 1 = n.4 G ^4.. 12 Clearly if [i(S) > 1/4, then 
/*(/*) ^ f*(KB), so fie \KB\x- Thus, [#5]* 5 {// G A x : ^(5) > 1/4}. On the other 
hand, if n G KB, then /*(//) C f*(KB). Thus, if G /*(//), since S € A, it must be the 
case that fi{S) = v(f(S)) > u(T) > 1/4. Thus, [KB} X Q {v G A x : > 1/4}. It 

follows that KB is equivalent to Pr(S') > 1/4, and so must be interesting. (We must also 
have T = f(S), although this is not needed for the result.) 

If KB is not interesting, then KB iff KB \= ip iff f*(KB) \= f*(p) (since entailment 

is representation independent) iff f*(KB) \^i^p>- On the other hand, if KB is interesting, 
then KB is equivalent to Pr(S') > 1/4 for some S C X, and f*(KB) is equivalent to 
Pr(/(S)) > 1/4. Moreover, KB 99 iff Pr(S") > 1/3 |= 99 iff Pr(/(S)) > 1/3 (= iff 
f*(KB) ip. Thus, we get representation independence, as desired. I 

A. 4 Proofs for Section 6 

Proposition 6.3: Suppose that f is a faithful X-Y embedding, T>x Q Ax, andDy Q Ay. 
The following two conditions are equivalent: 

(a) T>x and Vy correspond under f; 

(b) for allO, V X \= 9 iffVy \= f*(9). 

12. This is not in general true if X is infinite without the additional requirement that /(U; Ai) = Uif(Ai) 
for arbitrary unions. 
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Proof: To prove that (a) implies (b), assume by way of contradiction that, for some 9, 
V x ^0 but XV y= f*(9). Then there is some v G X>y such that v tf= f*(6). Let fj, G T>x be 
a measure corresponding to fx. Then, by Proposition 4.7, we have that \x \/= 9, the desired 
contradiction. The proof for the other direction of (a) is identical. 

To prove that (b) implies (a), first consider a measure y G T>x- We must find a v G XV 
such that z/ corresponds to jjl. Suppose that X = {xi, . . . , x n } (recall that we are restricting 
to finite spaces in Section 6) and that = m, i = 1, . . . , n. Let be the constraint 

A" =1 Pr({xj}) = dj. By our assumptions about the language, this constraint is in the 
language. Clearly \9Jx = {/•*}• Since \i G XV, we know that XV \£ Hence, X>y ^ 
/*(-i0), so that there exists i/ G X>y such that i/ /*(-i0). Hence i/ G f*(9) = /*({//}). By 
definition of /*, z/ corresponds to /x. 

Now consider a measure v G X>y, and let \i be the measure in Ax that corresponds 
to v. Assume by way of contradiction that \i XV- Taking 9 as above, it follows that 
T>x \= ~^9 and, therefore, by assumption, XV |= f*(—>6). Thus, v \= f*(~ i 9). But jjl \= 9 and, 
by assumption, /j, and v correspond. This contradicts Proposition 4.7. | 

Theorem 6.7: Let 9 be an arbitrary constraint on Ax- If f is a faithful X-Y embedding 
and fi and v correspond under f , then y\9 and v\f*{9) also correspond under f . 

Proof: Assume that fi and v correspond under /. Recall that we are assuming in this section 
that A is a finite space; let A = {x±, . . . , x n }. Let Y{ = f{xi). Given any distribution 
v" G Ay, define v" = v"\Yi and let (f*)~ l {v") denote the unique fj," G Ax such that 
v" G /*(/*"). 

Now suppose that // G \i\9. Define v' G Ay to be the measure such that 

v \v) = v'i x i) ■ My), 

where i is the index such that y G 1^. Since = v\Y{, it follows that v\{Yj) = 1. Thus, 
v'iYi) = /J,(xi), and v' leaves the relative probabilities of elements within each Yi the same 
as in v. It is easy to verify that u' and y! correspond. Hence, by Proposition 4.7, v' |= f*{9). 
We claim that v' G v\f*{9). To show that, we need show only that KLy{y%v) is minimal 
among all Khy{y"\v s ) such that v" \= f*(9). It follows from standard properties of relative 
entropy (Cover & Thomas, 1991, Theorem 2.5.3) that for all v" G Ay, we have 

n 

AXy(^^) = Ax x ((r)- i (^)ii(r)- 1 (^))+E^(^ii^)- 

i=i 

Note that i/j = v[, so AXy(z/||z/j) = 0, for i = 1, . . . , n. Thus, it follows from (1) that 
KL Y (v'\\v) = KLxin'U). 

Now, let v" G Ay be such that v" |= f*(9) and let = (f*)' 1 ^"). Since i/' and /x" 
correspond under /, it follows from Proposition 4.7 that /j," \= 9. Using (1) once again, we 
have that 

n 

KL Y {y"\\v) = KL x (y"\\fi) + ^2 KL Y(4'\h) 

i=i 
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But since y! <G fi\6, we know that KLx(l~i'\\y) < KLx(fi"\\n). Hence we conclude that 

KLy(v"\\v) > KLy(l/\\v), 

so that v' e v\f*{0). | 

Theorem 6.9: If f is a faithful X-Y embedding, then I v is invariant under f iffV(X) 
and V(Y) correspond under f. 

Proof: Suppose that / is a faithful X-Y embedding. By definition, l v is invariant under 
/ iff, for all KB, 9, we have 

KB^ lV 6i& f*(KB)^ lV f*(e). (2) 

By definition of I v , (2) holds iff 

V(X)\KB C \9\ x iff V(Y)\f*{KB) C \f*{9)\ Y for all KB, 6. (3) 

By Proposition 6.3, (3) holds iff V{X)\KB and V(Y)\f*(KB) correspond for all KB. By 
Corollary 6.5, \iV{X) and V{Y) correspond, then V{X)\KB and V(Y)\f*(KB) correspond 
for all KB. On the other hand, if V{X)\KB and V{Y)\f*(KB) correspond for all KB, then 
V(X) and ViY) must correspond: simply take KB = true and observe that V(X)\KB) = 
V{X) and V{Y)\f*{KB) = V{Y). I 

Proposition 6.10: Suppose that X± x • • • x JT n is t/ie product decomposition on X and, 
for each i = 1, . . . , n, KB, L is a constraint on X; L , and Si is a subset of X; L . Then 

n n 

f\ KBi h /pn Pr^ A . . . A S n ) = [J Pr(Si). 
i=i n i=i 

Proof: If KBi is a satisfiable constraint on Ax,, for i = 1, . . . ,n, then there exist product 
measures on X satisfying the constraints /\f=i KB^. These product measures are precisely 
the measures in Vu\(A7=i KBi)- Since each of these measures satisfies Pr(5i A ... A S n ) = 
nr=i P r (<%) by assumption, the conclusion holds in this case. If any constraint KBi is not 
satisfiable, then the result trivially holds. | 

Theorem 6.11: The inference procedure I-p n is invariant under faithful product embed- 
dings and under permutation embeddings. 

Proof: Suppose that / is a faithful X-Y product embedding, X\ x • • • x X n is the product 
decomposition of X, and Y\ x ■ ■ ■ x Y n is the product decomposition of Y. To show that 
Vn is invariant under /, it suffices to show that Vji(X) and Vu(Y) correspond under /. 
Supposethat fi £ Vji(Y). Then fx = fj,± x • • • x fi n , where /ij is a measure on Xi, i = 1, . . . , n. 
Moreover, since / is a product embedding, there exist f\,...,f n such that / = /i x • • ■ x /„. 
Let Vi € f*(fii), for i = 1, . . . , n. It is easy to check that v = v\ x ■ ■ ■ x v n G 

Conversely, suppose that ^ € T^ntX)- Then i/ = i/i x • • • x i/ n , where ^ £ Ay ; for 
z = l,...,n. Define /U G Ax, by setting fii(S) = Ui{fi{S)). Since /, is a faithful Xj-Y^ 
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embedding, is easy to check that \n £ Ax t and that i>i G f*(jXi). Thus, ^ € f*(p)- This 
completes the proof that Vu is invariant under faithful X-Y product embeddings. 

The argument that Vj\ is invariant under faithful X-X permutation embeddings is 
similar (and easier). We leave details to the reader. | 
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